Real AI incident

Mata v. Avianca: what happened when lawyers cited fake ChatGPT cases?

Two New York lawyers filed a brief full of court decisions that ChatGPT invented, asked the chatbot if they were real, and ended up sanctioned by a federal judge.

Adnyesh Dalpati · 7 min read

Quick answer In Mata v. Avianca, a personal injury case against the airline in federal court in Manhattan, lawyers filed a brief in March 2023 citing court decisions that ChatGPT had invented. On June 22, 2023, Judge P. Kevin Castel sanctioned attorneys Steven A. Schwartz and Peter LoDuca and their firm, imposing a $5,000 penalty and finding bad faith.

What happened in Mata v. Avianca?

The case itself is ordinary. Roberto Mata says a metal serving cart struck his left knee on a flight from El Salvador to New York's JFK airport. He sues Avianca. The airline moves to dismiss, arguing the claim is time-barred under the Montreal Convention, the treaty that governs international air travel claims.1

Mata's lawyer, Steven A. Schwartz of Levidow, Levidow & Oberman, needs cases showing the deadline was paused by the airline's bankruptcy. His firm's research service has limited access to federal cases. So he tries something new.1

He later told the court he had heard about a new site that he "falsely assumed was like a super search engine called ChatGPT, and that's what I used."1 He had never used ChatGPT before.1

He asks it to argue that bankruptcy tolls the limitations period. Then for case law. Then: "show me more cases."1 ChatGPT obliges. It produces cases with names, citations, judges and quotes. On March 1, 2023, a filing signed by his colleague Peter LoDuca, the attorney of record, cites them to the court.1

Two weeks later, Avianca's lawyers reply. They say they have been "unable to locate most of the case law cited," and they list seven purported decisions by name.1

In April, the court orders the lawyers to produce the cases. Screenshots Schwartz later filed show he had asked ChatGPT "Is Varghese a real case" and "Are the other cases you provided fake." ChatGPT answered that it had supplied "real" authorities that could be found through Westlaw, LexisNexis and the Federal Reporter.1

They were not real. The lawyers acknowledged that six of the decisions, including "Varghese," were generated by ChatGPT and do not exist.1

Its legal analysis is gibberish.

Judge P. Kevin Castel on the fake "Varghese" decision, Opinion and Order on Sanctions, June 22, 2023

What did Judge Castel decide?

The judge was clear that the tool was not the core problem. "Technological advances are commonplace and there is nothing inherently improper about using a reliable artificial intelligence tool for assistance," he wrote. "But existing rules impose a gatekeeping role on attorneys to ensure the accuracy of their filings."1

What turned a mistake into sanctions was what came after. The lawyers, the opinion says, "abandoned their responsibilities when they submitted non-existent judicial opinions with fake quotes and citations created by the artificial intelligence tool ChatGPT, then continued to stand by the fake opinions after judicial orders called their existence into question."1 If they had come clean after Avianca's March 15 brief, or after the court's April orders, "the record now would look quite different."1 The first admission did not come until May 25.1

The court found bad faith on the part of both individual lawyers, based on "acts of conscious avoidance and false and misleading statements to the Court."1 LoDuca had signed the filing without reviewing any of the cases cited in it.1

$5,000Penalty imposed jointly on the two lawyers and their firmSanctions order, June 22, 2023
6Fake decisions the lawyers admitted ChatGPT generatedSanctions order
7Purported decisions Avianca's lawyers said they could not findSanctions order

The sanctions: a $5,000 penalty imposed jointly and severally on Schwartz, LoDuca and the firm, plus letters to their client and to each judge falsely named as the author of a fake opinion, each with a copy of the sanctions order attached.1 The court did not require an apology, noting that "a compelled apology is not a sincere apology."1 The firm said in a statement that it "respectfully" disagreed that its lawyers had acted in bad faith: "We made a good-faith mistake in failing to believe that a piece of technology could be making up cases out of whole cloth."2 In a separate opinion, the judge threw out Mata's underlying claim because the statute of limitations had expired.2

Why it happened

ChatGPT is a language model. It produces text that sounds right, and a court citation is just a pattern of text. The Guardian explained that chatbots like ChatGPT can be prone to "hallucinations," and that their human-seeming responses can convince users an answer is correct.2 Asking the chatbot whether its own cases were real did not help. It said yes.

Schwartz himself described the trap in a court filing: he "could not fathom that ChatGPT could produce multiple fictitious cases, all of which had various indicia of reliability such as case captions, the names of the judges from the correct locations, and detailed fact patterns and legal analysis that sounded authentic."1

But the model was only one link in the chain. A second lawyer signed without reading the cases. Schwartz testified that when he looked for "Varghese" he "couldn't find it," yet the April 25 affidavit did not say so. And when the other side raised the alarm, the lawyers did not stop and check. The judge wrote that reading only the opening passages of the fake "Varghese" decision would have revealed that it was "internally inconsistent and nonsensical."1

Key takeaways
  • Lawyers in Mata v. Avianca cited court decisions that ChatGPT invented, and ChatGPT told them the cases were real.
  • Judge Castel said using AI is not improper, but lawyers must check what they file.
  • The sanctions, including a $5,000 penalty, came mainly because the lawyers stood by the fake cases after being challenged.
  • Asking an AI to verify its own output is not verification.

What this means for your business

You may never file a legal brief. But you probably publish product claims, policy pages, supplier emails and blog posts, and more of that text now starts in an AI tool. The Mata lessons carry over:

  • Check facts against a real source, not the AI. If a draft cites a study, a law, a price or a statistic, open the original. Asking the chatbot "is this real?" is not a check.
  • The person who signs is responsible. LoDuca signed without reading the cases. In your business, whoever hits publish or send owns the content.
  • When someone flags an error, stop and verify. The worst part of this case was doubling down. A quick correction is cheap; defending a mistake is expensive.
  • Keep a record. Schwartz's saved ChatGPT history showed the court exactly what he asked. Logs of who did what help you find and fix problems fast.

Air Canada learned a similar lesson when its chatbot invented a refund rule: see the Air Canada chatbot ruling. For the human check that catches these problems, read why the confirm button matters.

How ZNOS handles this

The way we run it, an AI employee drafts and a person decides what goes out. In ZNOS, each AI employee owns a job, such as Tanmay on growth and Suri on design, and works from the company's live data through the Brain rather than from guesses.

Content drafted by an agent waits for human approval before publishing. More broadly, autonomy is earned gradually: routine decisions are handled, and risky ones (money, customers, anything published under your name, production changes) wait for a human approval. An Audit Log records who changed what, so you can trace any problem back to where it started. You can meet the ZNOS team, or read more real AI incidents.

Frequently asked questions

What happened in Mata v. Avianca?

Roberto Mata sued Avianca over a knee injury on a flight. In March 2023 his lawyers filed a brief citing court decisions that turned out to have been invented by ChatGPT. After Avianca's lawyers said they could not find the cases, the court ordered them produced, and the lawyers eventually admitted six were fake.

What sanctions did Judge Castel impose?

On June 22, 2023, Judge P. Kevin Castel imposed a $5,000 penalty jointly on lawyers Steven A. Schwartz and Peter LoDuca and their firm, Levidow, Levidow & Oberman. They also had to send letters, with the sanctions order attached, to their client and to each judge falsely named as the author of a fake opinion.

Did ChatGPT say the fake cases were real?

Yes. Screenshots filed in the case show Schwartz asked ChatGPT whether one case was real and whether the other cases were fake. ChatGPT answered that it had supplied real authorities that could be found on Westlaw, LexisNexis and the Federal Reporter.

Is it illegal for lawyers to use ChatGPT?

No. Judge Castel wrote that there is nothing inherently improper about using a reliable artificial intelligence tool for assistance, but that existing rules require attorneys to ensure their filings are accurate.

Why were the lawyers found to have acted in bad faith?

The court found bad faith based on conscious avoidance and false and misleading statements to the court. The lawyers kept standing by the fake cases after Avianca and the court questioned whether they existed, and did not admit the truth until May 25, 2023.

What happened to Mata's lawsuit against Avianca?

In a separate opinion, the judge dismissed the underlying claim because the statute of limitations had expired, as reported by the Guardian.

Sources
  1. Mata v. Avianca, Inc., No. 22-cv-1461 (PKC) (S.D.N.Y. June 22, 2023), Opinion and Order on Sanctions, ECF 54 (via CourtListener RECAP): https://storage.courtlistener.com/recap/gov.uscourts.nysd.575368/gov.uscourts.nysd.575368.54.0.pdf
  2. The Guardian, Two US lawyers fined for submitting fake court citations from ChatGPT (June 23, 2023): https://www.theguardian.com/technology/2023/jun/23/two-us-lawyers-fined-submitting-fake-court-citations-chatgpt
Adnyesh Dalpati

Founder of ZNOS, where brands recruit an AI team of agents that ask before anything risky.

Keep reading