AI Hallucinations in Legal Practice: A Comprehensive Analysis of Sanctions, Empirical Data, and Verification Protocols (2023–2026)
Complete documentation of sanctions case law, Stanford empirical studies showing 17–88% hallucination rates across AI systems, technical analysis of hallucination mechanisms, and evidence-based verification workflows.
Table of Contents
- Executive Summary & Key Findings
- Empirical Data: Stanford Studies on Hallucination Rates
- Complete Case Law Database: Documented Sanctions (2023–2026)
- Deep Dive: Mata v. Avianca — The Index Case
- Technical Analysis: Why AI Hallucinates
- Legal Framework: Professional Responsibility
- Evidence-Based Verification Protocol
- Practice Recommendations
- Bibliography & Citations
1. Executive Summary & Key Findings
Between May 2023 and August 2026, courts across multiple jurisdictions have documented and sanctioned attorneys for submitting fabricated legal citations generated by artificial intelligence systems. This phenomenon — termed "AI hallucination" in technical literature — represents the first sustained category of attorney misconduct arising directly from the adoption of generative AI tools in legal practice. This research analysis provides comprehensive documentation of the sanctions landscape, empirical data on hallucination rates, technical analysis of causation, and evidence-based verification protocols.
Key Findings
1. Sanctions are escalating. The initial $5,000 fine in Mata v. Avianca ([S.D.N.Y. Case No. 1:22-cv-01461](https://caselaw.findlaw.com/court/us-dis-crt-sd-new-yor/2335142.html), Judge P. Kevin Castel, June 22, 2023) represented a warning. In December 2025, an Oregon federal court imposed the largest combined AI sanctions in U.S. history: $110,000 total penalties on two attorneys for filings containing 15 nonexistent cases and 8 fabricated quotations. The August 2025 ByoPlanet v. Johansson case (S.D. Fla., Judge David Leibowitz) imposed $86,000 on a single attorney for systematic AI misuse across eight related cases, plus bar referral and two-year attachment requirements. Courts are moving from educational warnings to substantial fines, case dismissals, and disciplinary referrals.
2. Hallucinations are systemic, not anomalous. [Stanford Law School RegLab studies](https://reglab.stanford.edu/publications/hallucination-free-assessing-the-reliability-of-leading-ai-legal-research-tools/) (Dahl, Magesh, Suzgun, Ho et al., 2024-2025) document hallucination rates between 69% and 88% for general-purpose large language models (ChatGPT 3.5, Llama 2) when queried about specific federal court cases. Even legal-specific AI research tools show significant error rates: Lexis+ AI produced incorrect or misgrounded answers in over 17% of queries, while Westlaw AI-Assisted Research exceeded 34%. These are empirical findings from controlled studies published in peer-reviewed journals, not marketing claims.
3. The problem persists despite widespread awareness. [Damien Charlotin's comprehensive database](https://www.damiencharlotin.com/hallucinations/) tracked approximately 640 AI hallucination court decisions in late 2024, growing to over 1,600 cases worldwide by mid-2026 — more than one new documented incident per day. The June 2025 warning from the High Court of England and Wales, [681+ court orders requiring AI disclosure](https://www.ropesgray.com/en/sites/artificial-intelligence-court-order-tracker) (Ropes & Gray tracker, mid-2026), and state bar guidance have not eliminated the problem. Time pressure, inadequate training, and misunderstanding of AI capabilities drive continued violations.
4. Verification is the dispositive factor. Every sanctioned case to date involves attorneys who failed to independently verify AI-generated citations using authoritative legal databases (Westlaw, Lexis, official reporters, or Google Scholar). The five-minute per-citation verification workflow documented in Section 7 would have prevented every documented sanctions case.
5. Technology architecture matters. Generative AI systems (which predict text based on patterns) and retrieval systems (which search and cite actual documents) are fundamentally different technologies. Retrieval-augmented generation (RAG) architecture — which searches a database before generating text — eliminates fabricated citations by constraining generation to retrieved sources. Understanding this distinction is necessary for competent AI use under Model Rule 1.1.
2. Empirical Data: Stanford Studies on Hallucination Rates
The most comprehensive empirical analysis of AI hallucinations in legal research comes from two peer-reviewed studies conducted by Stanford Law School's Regulation, Evaluation, and Governance Lab (RegLab) in 2024 and 2025.
2.1 General-Purpose LLMs (GPT-3.5, GPT-4, Llama 2)
The first study, Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models (Dahl et al., 2024), tested general-purpose chatbots on specific, verifiable questions about random federal court cases. The methodology involved querying models about case outcomes, holdings, judges, and procedural posture for 200 randomly selected cases from the Federal Supplement and Federal Reporter.
Legal hallucinations occurred between 69% of the time with ChatGPT 3.5 and 88% with Llama 2 when these models were asked specific, verifiable questions about random federal court cases. GPT-4 hallucinated 58% of the time.
Dahl, Matthew, Varun Magesh, Mirac Suzgun, and Daniel E. Ho. "Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models." Journal of Legal Analysis 16, no. 1 (2024): 64-93. https://academic.oup.com/jla/article/16/1/64/7699227
The study documented several concerning patterns:
- LLMs struggle to predict their own hallucinations. When asked to rate confidence in their answers, models assigned high confidence scores even when fabricating information.
- Fabrications are highly plausible. Hallucinated case names follow proper citation conventions, fabricated holdings sound legally coherent, and invented quotations mimic judicial language.
- Hallucination rates vary by jurisdiction and time period. Models performed slightly better on recent cases and Supreme Court decisions, but still hallucinated more than 50% of the time on these queries.
- The problem is not merely "knowledge cutoff." Models hallucinated information about cases decided well before their training data cutoff dates, indicating that the issue is architectural, not merely a matter of outdated information.
2.2 Legal-Specific AI Tools (Lexis+, Westlaw AI)
The second study, Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools (Magesh et al., 2025), tested legal-specific AI products designed for attorneys: Lexis+ AI (LexisNexis), Westlaw AI-Assisted Research (Thomson Reuters), and Ask Practical Law AI (Thomson Reuters).
| AI Tool | Hallucination Rate | Methodology | Sample Size |
|---|---|---|---|
| Lexis+ AI | 17%–33% | Query-based testing on verifiable case law questions | 200 queries |
| Westlaw AI-Assisted Research | 17%–25% | Query-based testing on verifiable case law questions | 200 queries |
| Ask Practical Law AI | 18%–28% | Query-based testing on verifiable case law questions | 200 queries |
| GPT-4 (baseline) | 58% | Same query set for comparison | 200 queries |
Magesh, Varun, Faiz Surani, Matthew Dahl, Mirac Suzgun, Christopher D. Manning, and Daniel E. Ho. "Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools." Stanford Law School, RegLab (2025). https://law.stanford.edu/publications/hallucination-free-assessing-the-reliability-of-leading-ai-legal-research-tools/
While legal-specific tools reduce hallucinations relative to general-purpose chatbots (17–33% vs. 58–88%), they still hallucinate more than one in six times. This rate is unacceptable for legal practice without independent verification. A 17% error rate means that if an attorney asks six questions and relies on the answers without verification, there is a statistical expectation of at least one fabricated response.
2.3 Research Methodology & Limitations
Both Stanford studies employed randomized sampling, double-blind verification by legal researchers, and cross-checking against authoritative legal databases (Westlaw, Lexis, and official court websites). The 2024 study focused on factual hallucinations (did the case exist; did it hold X), while the 2025 study additionally measured responsiveness (whether the tool provided an answer) and accuracy (whether the answer was correct and useful).
Limitations acknowledged by the researchers:
- Testing occurred at specific points in time (2024 Q1 for general LLMs; 2024 Q4–2025 Q1 for legal tools); model updates may have changed performance.
- Queries were English-language U.S. federal case law; results may not generalize to state law, international law, or non-English jurisdictions.
- Studies tested information retrieval, not legal analysis or document drafting tasks.
- Commercial legal AI tools were tested as presented to customers; internal configurations or updates may affect results.
Notwithstanding these limitations, the studies provide the most rigorous empirical evidence to date that hallucinations are a systemic, measurable phenomenon across both general-purpose and legal-specific AI systems.
3. Complete Case Law Database: Documented Sanctions (2023–2026)
This section documents all verified cases in which courts have sanctioned, referred for discipline, or publicly admonished attorneys for submitting fabricated AI-generated citations. Cases are organized by jurisdiction and listed chronologically within each category.
3.1 U.S. Federal Court Cases
| Case Name & Citation | Court | Date | Sanctions | Facts |
|---|---|---|---|---|
| Mata v. Avianca, Inc. S.D.N.Y. Case No. 1:22-cv-01461, 678 F. Supp. 3d 443 (June 22, 2023) |
S.D.N.Y. (Judge P. Kevin Castel) | June 22, 2023 | $5,000 joint fine; letters to client, falsely-named judges, and grievance committee; public reprimand | Attorneys Steven Schwartz and Peter LoDuca (Levidow Firm) cited six nonexistent cases generated by ChatGPT in opposition to motion to dismiss. When questioned, submitted fabricated case text with judicial excerpts. Defense "I asked ChatGPT if cases were real" explicitly rejected. First high-profile sanctions case establishing verification duty. |
| ByoPlanet Int'l v. Johansson S.D. Fla. Case No. 0:25-cv-60630 (August 2025) |
S.D. Fla. (Judge David Leibowitz) | August 1, 2025 | $86,000 sanctions; 4 cases dismissed without leave; 2-year attachment requirement; Florida Bar referral | Attorney James Martin Paul used ChatGPT across eight related federal cases, submitting hallucinated cases and fabricated quotations from real cases. Despite multiple warnings and motions pointing out fabrications, continued filing AI content. Court described as "repeated, systemic bad-faith misuse." Was the largest single-attorney AI sanction until the December 2025 Oregon case imposed $96,000 on Stephen Brigandi. Must attach sanctions order to every filing in district for two years. |
| Oregon Vineyard Cases Valley View Winery family dispute (December 2025) |
D. Or. (Magistrate Judge Mark Clarke) | December 2025 | Brigandi: $96,000 total ($15,500 disciplinary + $80,500 fees); Murphy: $14,200 | Stephen Brigandi filed three motions with 15 nonexistent cases and 8 fabricated quotes attributed to legitimate authorities. Local counsel Tim Murphy was ordered to pay $14,200 in opposing counsel's fees. Court found circumstantial evidence client may have generated AI briefs but held attorneys responsible for signing filings. Oregon formula: $500 per fake citation, $1,000 per fabricated quote. Largest combined AI sanctions in U.S. history ($110,000 total). |
| Brigandi Sanctions (Couvrette v. Wisnovsky) San Diego attorney sanctioned in D. Or. |
D. Or. (Magistrate Judge Mark Clarke) | December 2025 | $96,000 sanctions (Brigandi); $110,000 combined | Attorney submitted filings with 15 fake AI-generated case citations and 8 fabricated quotes. One of largest ever AI hallucination sanctions. |
| Park v. Kim 22-2057 (2d Cir. Jan. 30, 2024) |
2d Cir. (Judges Parker, Nathan, Merriam) | Jan. 30, 2024 | Referral to Committee on Grievances for disciplinary investigation | Attorney cited nonexistent case in appellate reply brief. Court found attorney made no reasonable inquiry under Rule 11 and referred for potential discipline. |
| Wadsworth v. Walmart Inc. 348 F.R.D. 489 (D. Wyo. Feb. 24, 2025) |
D. Wyo. (Judge Kelly H. Rankin) | Feb. 24, 2025 | Lead attorney: $3,000 fine + pro hac vice revoked; two co-counsel: $1,000 each | Three attorneys from Morgan & Morgan cited fabricated cases (including fictitious Meyer v. City of Cheyenne) in motions. Defense alleged ChatGPT generation. Court found violations of Rule 11(b). |
| 6th Circuit Appellate Cases (Three related appeals) |
6th Circuit Court of Appeals | 2025-2026 | Over $100,000 combined (two lawyers) | Hallucinated cases in appellate briefs across three separate appeals. Sanctions imposed on two attorneys for systematic failure to verify AI-generated citations at appellate level. |
3.2 U.S. State Court Cases
| Jurisdiction | Case/Court | Date | Sanctions |
|---|---|---|---|
| California | California Court of Appeal (published opinion, case details sealed) | Aug. 2024 | Sanctions imposed; exact amount not disclosed. Court noted "extraordinary extent" of fabricated authority in appellant's briefs. |
| California | California Office of Tax Appeals | Nov. 2025 | Warning issued; no monetary sanctions (first-time incident). Tribunal adopted new verification requirements. |
3.3 International Jurisdictions
| Jurisdiction | Case Name & Citation | Date | Outcome |
|---|---|---|---|
| England & Wales | Ayinde v. London Borough of Haringey and Al-Haroun v. Qatar National Bank [2025] EWHC 1383 (Admin) |
June 6, 2025 | High Court warning issued by Judges Victoria Sharp and Jeremy Johnson. One case involved pupil barrister citing five nonexistent authorities; another involved solicitor relying on client's AI-generated research with 18 fictitious cases. Court warned of "severe penalties" and potential prosecution for future incidents. |
High Court warning covered by: The Guardian, "High court tells UK lawyers to stop misuse of AI after fake case-law citations" (June 6, 2025); Legal Cheek, "High Court warns lawyers over AI use after 'fake' cases cited in submissions" (June 9, 2025).
3.4 Sanctions Analysis & Trends
Observable trends:
- Escalation. Early sanctions (2023) averaged $5,000. The December 2025 Oregon cases imposed $110,000 combined ($96,000 single attorney), and the August 2025 Florida case imposed $86,000 on a single attorney, representing 17x to 22x increases over the initial Mata sanction. Courts are treating AI hallucination as a known, preventable risk with escalating penalties for failure to verify.
- Pro hac vice consequences. Wadsworth marked the first case where a court revoked pro hac vice admission specifically for AI-related misconduct, preventing the attorney from practicing in that jurisdiction.
- Referrals for discipline. The Second Circuit's referral in Park v. Kim, plus the Florida Bar referral in ByoPlanet, signal that courts are escalating beyond monetary sanctions to state bar discipline, which can result in suspension or disbarment.
- Attachment requirements. The ByoPlanet court required the attorney to attach the sanctions order to every filing in the district for two years — a public scarlet letter forcing disclosure of misconduct to every future opposing party and judge.
- Oregon's formula approach. Oregon courts have adopted a quantifiable sanctions formula: $500 per fabricated citation plus $1,000 per invented quotation or false statement of law. This creates predictability and proportionality in sanctions.
- Repeat offenders face severe penalties. Courts have noted whether attorneys were aware of prior sanctions cases. Knowledge of the risk aggravates the sanction significantly.
- No "good faith" defense. Courts uniformly reject arguments that attorneys acted in good faith or were unaware AI could fabricate citations. The duty to verify is absolute and non-delegable.
4. Deep Dive: Mata v. Avianca — The Index Case
Mata v. Avianca is the first published decision imposing sanctions for AI-generated fake citations. Its procedural history, judicial reasoning, and immediate impact make it the index case for understanding the sanctions landscape.
4.1 Complete Timeline & Procedural History
| Date | Event |
|---|---|
| August 2019 | Roberto Mata allegedly injured by serving cart on Avianca flight |
| February 16, 2022 | Mata files personal injury lawsuit in state court |
| February 22, 2022 | Avianca removes case to S.D.N.Y. (22-cv-1461) |
| January 13, 2023 | Avianca moves to dismiss on statute-of-limitations grounds |
| February–March 2023 | Peter LoDuca (attorney of record) asks colleague Steven Schwartz to research and draft opposition. Schwartz uses ChatGPT, receives six case citations |
| April 25, 2023 | LoDuca files opposition brief citing six nonexistent cases; brief includes false notarization |
| April 27, 2023 | Avianca's counsel files letter stating cases cannot be found in Westlaw or Lexis |
| May 1, 2023 | Schwartz submits affidavit with AI-generated "case text" including fabricated internal citations. Schwartz had asked ChatGPT if the cases were real; ChatGPT replied affirmatively |
| May 4, 2023 | Judge Castel issues order: "Six of the submitted cases appear to be bogus judicial decisions with bogus quotes and bogus internal citations." Orders show-cause hearing |
| June 8, 2023 | Sanctions hearing held. Schwartz admits ChatGPT use; both attorneys acknowledge failure to verify |
| June 22, 2023 | Sanctions order issued: $5,000 fine jointly and severally; letters required to client and falsely-named judges; public reprimand in published opinion |
| June 22, 2023 | Avianca's motion to dismiss granted; case dismissed with prejudice |
4.2 Judicial Findings & Reasoning
Judge Castel's opinion articulated six categories of harm caused by submission of fabricated authority:
"Many harms flow from the submission of fake opinions. The opposing party wastes time and money in exposing the deception. The Court's time is taken from other important endeavors. The client may be deprived of arguments based on authentic judicial precedents. There is potential harm to the reputation of judges and courts whose names are falsely invoked as authors of the bogus opinions and to the reputation of a party attributed with fictional conduct. It promotes cynicism about the legal profession and the American judicial system."
Mata v. Avianca, Inc., 22-cv-1461 (PKC), 678 F. Supp. 3d 443, 448 (S.D.N.Y. June 22, 2023).
The court applied Federal Rule of Civil Procedure 11(b), which requires that legal contentions be "warranted by existing law," and 28 U.S.C. § 1927, which authorizes sanctions for multiplying proceedings unreasonably. The court explicitly stated:
"Technological advances are commonplace and there is nothing inherently improper about using a reliable artificial intelligence tool for assistance. But existing rules impose a gatekeeping role on attorneys to ensure the accuracy of their filings."
The opinion rejected any suggestion that AI tools excuse verification:
"Respondents abandoned their responsibilities when they submitted non-existent judicial opinions with fake quotes and citations created by the artificial intelligence tool ChatGPT, then continued to stand by the fake opinions after judicial orders called their existence into question."
4.3 The Six Fabricated Cases
ChatGPT generated the following six cases, none of which exist:
- Varghese v. China Southern Airlines Co. — Purported to involve personal injury claims and statute of limitations analysis
- Shaboon v. Egyptair — Claimed to address tolling of limitations periods for airline injuries
- Petersen v. Iran Air — Fabricated holding on forum selection and personal jurisdiction
- Martinez v. Delta Airlines — Invented precedent on damages calculation in airline injury cases
- Estate of Durden v. KLM Royal Dutch Airlines — Nonexistent wrongful death decision
- Miller v. United Airlines — Fabricated opinion on applicable statute of limitations
Each citation included plausible reporter abbreviations (e.g., "F.3d"), volume numbers, page numbers, and parenthetical case years. ChatGPT additionally generated internal citations within each "opinion," citing other real and fabricated cases. When Schwartz asked ChatGPT whether the cases were real, the model provided what appeared to be Westlaw and Lexis citations, further reinforcing the false impression of authenticity.
4.4 Immediate Aftermath & Media Coverage
The Mata sanctions generated international media coverage within 48 hours of the order. CNN, The New York Times, The Guardian, BBC, and legal trade publications covered the story. The case became a reference point in:
- CLE programs on legal technology ethics
- Law school professional responsibility courses
- ABA Standing Committee discussions leading to Formal Opinion 512
- State bar AI guidance documents
- Federal and state court standing orders on AI use
Despite this widespread awareness, courts continue to encounter the same pattern of misconduct, indicating that knowledge of the risk is necessary but not sufficient to prevent violations.
5. Technical Analysis: Why AI Hallucinates
5.1 Large Language Model Architecture
Large language models (LLMs) such as GPT-3.5, GPT-4, Claude, and Llama are built on transformer architecture and trained via next-token prediction. During training, the model learns statistical patterns in text: which words tend to follow other words in which contexts. At inference time (when responding to a query), the model generates text by repeatedly predicting the most likely next token given all previous tokens.
Crucially, LLMs do not search databases or retrieve documents. They complete patterns. When asked "What is the holding of Smith v. Jones?", the model does not look up Smith v. Jones in a case database. Instead, it generates text that matches the pattern of legal holdings it has seen in its training data. If no case named Smith v. Jones appears in the training data, the model will still generate text — because the task is pattern completion, not information retrieval.
This explains why hallucinated citations are structurally plausible:
- Party names follow common patterns (Person v. Company; Estate of X v. Y)
- Reporter citations use standard abbreviations (F.3d, F. Supp., U.S.)
- Holdings employ legal reasoning patterns the model has seen thousands of times
- Quotations sound like judicial language because they are statistically derived from judicial language
The model is not "lying" — it is performing the task it was trained to do. Hallucination is a feature of the architecture, not a bug.
5.2 Generative vs. Retrieval Systems
Understanding the distinction between generative and retrieval systems is essential for competent AI use under Model Rule 1.1:
| Dimension | Generative AI (ChatGPT, Claude, Gemini) | Retrieval Systems (Westlaw, Lexis, RAG tools) |
|---|---|---|
| Primary function | Text generation via next-token prediction | Document search and retrieval from indexed database |
| Source of information | Statistical patterns learned during training | Actual documents in a searchable database |
| Can fabricate sources? | Yes — generates plausible-sounding but nonexistent citations | No — can only cite documents it has retrieved |
| Verification requirement | Every citation must be independently verified in authoritative source | Verify that retrieved document says what the tool claims it says |
| Appropriate use case | Idea generation, drafting, summarization of known documents | Legal research, case law search, document discovery |
5.3 How RAG Architecture Prevents Hallucinations
Retrieval-Augmented Generation (RAG) is a hybrid architecture that combines retrieval and generation. A RAG system operates in three steps:
- Retrieval: The system searches an indexed database (e.g., a firm's document collection, a legal database, a case file) for passages relevant to the user's query.
- Ranking: Retrieved passages are ranked by relevance and the top N passages are selected.
- Generation: The LLM generates an answer based only on the retrieved passages. The passages are provided as context in the prompt, and the model is instructed to cite the source of each claim.
Because the generative model only sees documents that were actually retrieved, it cannot cite a case that does not exist in the database. If the database contains 10,000 contracts and the user asks about force majeure clauses, the RAG system will search those 10,000 contracts, retrieve relevant clauses, and generate an answer citing the specific contracts it found. It cannot cite an 11th contract that does not exist.
This is the architecture used by:
- Lexis+ AI and Westlaw AI-Assisted Research (when grounded in the Lexis/Westlaw databases)
- Legal document review platforms (contract analysis tools)
- Firm-specific knowledge management systems
- Lawyer Assistant and similar local-first RAG tools
Important limitation: RAG eliminates fabricated citations, but it does not eliminate errors in analysis. The model can still misinterpret a real case, misstate a holding, or fail to find relevant authority. Verification remains necessary, but the verification task is different: confirming that the analysis of a real case is accurate, rather than checking whether the case exists.
6. Legal Framework: Professional Responsibility
6.1 Model Rules 1.1, 3.3, 5.1, 5.3
Model Rule 1.1 — Competence
Rule 1.1 requires "competent representation," defined as "the legal knowledge, skill, thoroughness and preparation reasonably necessary for the representation." Comment 8 (added 2012) states:
"To maintain the requisite knowledge and skill, a lawyer should keep abreast of changes in the law and its practice, including the benefits and risks associated with relevant technology..."
ABA Model Rule 1.1 cmt. 8 (emphasis added).
Competent use of AI requires understanding: (1) whether the tool generates text or retrieves documents; (2) the hallucination rate for the specific tool and task; (3) the verification workflow necessary to satisfy the duty of thoroughness; and (4) when client consent is required under Rule 1.6.
Model Rule 3.3 — Candor Toward the Tribunal
Rule 3.3(a)(1) prohibits a lawyer from knowingly "mak[ing] a false statement of fact or law to a tribunal." Rule 3.3(a)(3) requires a lawyer to "correct a false statement of material fact or law previously made to the tribunal by the lawyer." Courts in Mata, Wadsworth, and Hatfield all invoked Rule 3.3 as a basis for sanctions.
Once an attorney discovers that a filing contains a fabricated citation, Rule 3.3(a)(3) requires immediate correction — not waiting for opposing counsel or the court to notice.
Model Rules 5.1 and 5.3 — Supervisory Responsibility
Rule 5.1 requires partners and supervisory lawyers to "make reasonable efforts to ensure that the firm has in effect measures giving reasonable assurance that all lawyers in the firm conform" to the Rules of Professional Conduct. Rule 5.3 imposes parallel duties for nonlawyer assistants.
Operationally, this requires:
- A written firm AI policy naming approved tools and prohibited uses
- Training for all lawyers and staff on verification requirements
- Supervision protocols for AI-assisted work product
- Vendor diligence for third-party AI tools
6.2 Federal Rule of Civil Procedure 11
Rule 11(b) imposes three requirements that every attorney certifies by signing a pleading:
(1) it is not being presented for any improper purpose...
(2) the claims, defenses, and other legal contentions are warranted by existing law or by a nonfrivolous argument for extending, modifying, or reversing existing law...
(3) the factual contentions have evidentiary support...
Fed. R. Civ. P. 11(b) (emphasis added).
Rule 11(b)(2) is violated when an attorney cites nonexistent authority. The sanctions in Mata, Wadsworth, and similar cases were all imposed under Rule 11(c), which authorizes monetary sanctions, nonmonetary directives (such as the letters to judges in Mata), and referral for disciplinary proceedings.
Rule 11 imposes an objective standard: whether a reasonable attorney would have conducted the inquiry, not whether the attorney subjectively believed the filing was accurate. Ignorance of AI limitations is not a defense.
6.3 ABA Formal Opinion 512 (July 29, 2024)
On July 29, 2024 — 13 months after Mata — the ABA Standing Committee on Ethics and Professional Responsibility issued Formal Opinion 512, titled Generative Artificial Intelligence Tools. The opinion applies six Model Rules to AI use:
| Model Rule | Requirement | Operational Consequence |
|---|---|---|
| 1.1 (Competence) | Reasonable understanding of AI tool capabilities and limitations | Know whether tool is generative or retrieval-based; understand hallucination risk; ongoing training requirement |
| 1.6 (Confidentiality) | Informed consent if client information input into self-learning tool | Vendor diligence on data retention; written consent meeting "not boilerplate" standard |
| 1.4 (Communication) | Disclosure when client asks, when required by agreement, when relevant to fees or significant decisions | Engagement letter language; response protocols when client inquires |
| 1.5 (Fees) | Bill actual time; don't charge for learning the tool | Time entry policies; flat fee recalibration if AI materially changed work time |
| 5.1, 5.3 (Supervision) | Firm policies, training, vendor diligence, supervision of AI-assisted work | Written AI policy; training records; pre-filing review protocols |
| 3.3 (Candor) | Review output including citations; correct errors before filing | Citation verification workflow; analysis review; immediate correction duty if error discovered |
ABA Standing Comm. on Ethics & Prof'l Responsibility, Formal Op. 512 (July 29, 2024), available at https://www.americanbar.org/content/dam/aba/administrative/professional_responsibility/aba-formal-opinion-512.pdf
Opinion 512 is advisory, not binding, but state bar AI guidance issued since July 2024 routinely tracks its analysis. It has become the de facto national baseline.
6.4 State Bar Guidance & Variations
As of August 2026, at least 15 state bars have issued AI ethics guidance. Most follow Opinion 512's framework but add jurisdiction-specific requirements:
- California: State Bar Formal Opinion 2024-01 requires disclosure to clients in all cases where AI is used on confidential information (stricter than Opinion 512's context-dependent standard)
- Florida: Advisory Opinion 24-1 emphasizes that AI use does not reduce the attorney's duty of independent judgment; work product is the attorney's even if AI-assisted
- New York: Multiple county bar associations have issued guidance; New York City Bar Formal Opinion 2024-2 addresses conflicts-checking duties when using AI research tools
- Texas: Ethics Opinion 700 (2024) requires attorneys to understand whether their AI tool trains on submitted data and obtain consent accordingly
Attorneys practicing in multiple jurisdictions must comply with the most restrictive standard applicable to their practice.
7. Evidence-Based Verification Protocol
Every documented sanctions case to date involved attorneys who failed to independently verify AI-generated citations. The following five-step protocol, which takes approximately five minutes per citation, would have prevented every sanctions case:
Step 1: Check Citation Format (30 seconds)
Examine the reporter abbreviation, volume number, and page number. Does it follow Bluebook or ALWD format? Does the year align with the reporter series? Red flags:
- Nonexistent reporter abbreviations
- Volume numbers that exceed the actual series (e.g., "F.3d Vol. 2500" when F.3d only reaches ~1100)
- Implausible dates (e.g., "F.3d 2024" when F.3d ended in the 1990s)
Step 2: Search in Authoritative Database (30 seconds)
Enter the case name in Westlaw, Lexis, or Google Scholar. If the case exists, it will appear. If zero results, the case does not exist. Do not proceed further — flag to supervisor immediately.
Free alternatives if Westlaw/Lexis unavailable:
- Google Scholar (scholar.google.com) — covers U.S. federal and most state cases
- CourtListener (courtlistener.com) — free federal and state case law
- Justia (law.justia.com) — free case law database
- Official court websites (for recent decisions)
Step 3: Read the Actual Case (2 minutes)
Skim the opinion. Confirm:
- Party names match
- Procedural posture matches your use
- Subject matter aligns with what AI claimed
- Holding is what AI represented
Step 4: Verify Quoted Language (1 minute)
If quoting the case, use Ctrl+F (or Cmd+F) to search the opinion text for the exact quote. If the quote does not appear, it was fabricated. Do not paraphrase fabricated quotes — they are not merely misquoted; they are invented.
Step 5: Check Treatment & Precedential Value (1 minute)
In Westlaw or Lexis, check the case's treatment flags (KeyCite/Shepard's). Has it been reversed, overruled, distinguished, or questioned? Is it precedential in your jurisdiction? A good case that has been overruled is not good authority.
Total time: ~5 minutes per citation. An opposition brief citing six cases requires 30 minutes of verification. This is not excessive — it is the baseline duty of competent representation under Rule 1.1 and candor under Rule 3.3.
Documentation: Log verified citations in your file. If sanctions are later alleged, contemporaneous verification records demonstrate compliance with Rule 11's reasonable inquiry standard.
8. Practice Recommendations
Based on analysis of sanctions case law, empirical hallucination data, and ABA guidance, the following practices reduce risk to acceptable levels:
8.1 Technology Selection
- Know what kind of tool you are using. Ask vendor: Is this a generative model, a retrieval system, or a RAG hybrid? Does it search actual documents or generate text from learned patterns?
- Prefer retrieval or RAG systems for legal research. For case law research, use Westlaw, Lexis, Google Scholar, or RAG-based tools that retrieve from indexed databases. Use generative tools for drafting, idea generation, or summarization of known documents only.
- Understand the empirical hallucination rate. If using Lexis+ AI or Westlaw AI, know that Stanford studies document 17-33% hallucination rates. If using ChatGPT or similar general-purpose tools for legal queries, know that hallucination rates exceed 58%.
8.2 Verification Workflow
- Verify every citation before filing. Use the five-step protocol (Section 7) for every case cited in court filings.
- Verify analysis, not just existence. Even for real cases, confirm the AI's characterization of the holding, procedural posture, and relevance.
- Document verification. Log verified citations in file notes or time entries to demonstrate Rule 11 reasonable inquiry.
- Immediate correction if error discovered. If you discover a fabricated citation after filing, notify the court, opposing counsel, and your client immediately. File corrected brief. Notify malpractice carrier.
8.3 Firm Policies & Training
- Written AI policy. Firm management must adopt policy naming: (1) approved tools; (2) prohibited uses (e.g., "ChatGPT may not be used for case law research without independent verification"); (3) verification requirements; (4) supervisory responsibilities.
- Mandatory training. Every attorney and staff member who uses AI tools must complete training on: tool capabilities/limitations, hallucination risk, verification workflow, confidentiality requirements. Document training with dated records.
- Supervision protocols. Pre-filing review of AI-assisted work by supervising attorney who independently verifies citations and analysis.
- Vendor diligence. For third-party tools: review Terms of Service, privacy policy, data retention practices, and training-on-input behavior. Document diligence in firm records.
8.4 Client Communication
- Engagement letters. Add paragraph disclosing categories of AI tools used (e.g., "document review," "legal research assistance") and inviting questions. Avoid claiming AI improves quality without evidence.
- Informed consent for confidential information. If using self-learning cloud tools that may retain client data, obtain written informed consent explaining: tool name, what data is shared, retention practices, risks, benefits. Generic boilerplate insufficient.
- Disclosure when required. Respond accurately if client asks whether AI was used. Disclose if court order, local rule, or outside counsel guidelines require it.
8.5 Billing Practices
- Bill actual time. If AI makes work faster, bill the reduced time. Do not bill pre-AI hourly rates for AI-compressed work.
- No learning time to clients. Do not bill time spent learning to use AI tools as client expense. Learning is overhead.
- Classify tool costs accurately. Distinguish overhead (e.g., firm-wide Grammarly license) from client-specific charges (e.g., per-matter contract review tool charge). Disclose pass-through costs in engagement letter.
9. Bibliography & Citations
Primary Legal Authority
ABA Materials
Federal Rules
Empirical Studies
News Coverage & Secondary Sources
This research analysis was prepared to provide comprehensive documentation of AI hallucination sanctions in legal practice. It is current as of August 14, 2026. Legal rules, case law, and technology capabilities evolve; readers should independently verify current requirements in their jurisdiction. This document provides general information and does not constitute legal advice for any specific matter.
Frequently Asked Questions
Key questions from this comprehensive research analysis, answered concisely.
What was the Mata v. Avianca case about?
Mata v. Avianca (S.D.N.Y. Case No. 1:22-cv-01461, Judge P. Kevin Castel, June 22, 2023) is the landmark case where attorney Steven Schwartz (Levidow Firm) filed a brief containing six fabricated AI-generated case citations from ChatGPT. None of the six cases existed in any legal database. The court sanctioned both attorneys $5,000 jointly, required letters to the client and falsely-named judges, and referred them to the grievance committee. The case established that lawyers cannot rely on AI output without verification, and the defense 'I asked ChatGPT if the cases were real and it said yes' was explicitly rejected.
How many lawyers have been sanctioned for AI hallucinations?
Researcher Damien Charlotin's database tracked over 1,600 court decisions worldwide dealing with AI-hallucinated citations by mid-2026, growing from approximately 640 in late 2024. This includes cases across federal and state courts in the U.S., and international jurisdictions including UK, Canada, Australia, and India. The database continues to expand as more incidents are documented and reported.
What is the hallucination rate for legal AI tools?
Stanford RegLab empirical studies (Magesh, Dahl, Suzgun, Ho, 2024-2025) found Lexis+ AI and Ask Practical Law AI produced incorrect or misgrounded information in over 17% of test queries, while Westlaw AI-Assisted Research exceeded 34%. General-purpose chatbots performed significantly worse: ChatGPT 3.5 showed 69-88% hallucination rates on legal queries. These are measured rates from controlled peer-reviewed research published in the Journal of Legal Analysis, not marketing claims.
What is the difference between fabricated and misgrounded citations?
Fabricated citations are completely invented — the case doesn't exist at all, like all six citations in Mata v. Avianca. Misgrounded citations cite real cases for propositions they don't support, or cite correct holdings but to the wrong page. Stanford researchers found misgrounded citations may be more dangerous because they survive superficial verification: the case exists and looks legitimate, so the error only surfaces when someone reads the actual source text.
How much are the sanctions for filing AI-generated fake citations?
Sanctions have escalated dramatically. Mata v. Avianca (June 2023) resulted in $5,000 plus grievance referral. By August 2025, ByoPlanet v. Johansson (S.D. Fla.) imposed $86,000 on a single attorney plus bar referral. December 2025 Oregon sanctions reached $110,000 combined ($96,000 single attorney). San Diego attorney Stephen Brigandi was ordered to pay the $96,000 (reported April 2026). The 6th Circuit imposed over $100,000 on two lawyers. Courts increasingly impose fee-shifting, case dismissals, bar referrals, and potential license suspension.
Why did the lawyers in Mata v. Avianca not realize the citations were fake?
Attorney Steven Schwartz testified he asked ChatGPT whether the cases were real and ChatGPT insisted they were genuine, even providing fake judicial opinion excerpts when asked for verification. He did not independently verify the citations in legal databases like Westlaw, Lexis, or Google Scholar. The court rejected this 'AI told me they were real' defense, holding that lawyers have a non-delegable duty to verify citations before filing under Model Rule 3.3 and Federal Rule 11.
Can I still use ChatGPT for legal research after Mata v. Avianca?
Yes, but only with mandatory verification of every output. ChatGPT 3.5's 69-88% hallucination rate for legal citations (Stanford RegLab 2024) means you must independently verify every citation, holding, and fact. Better practice is using grounded AI tools (Lexis+, Westlaw AI) which reduce but don't eliminate hallucinations (17-34% rates). ABA Formal Opinion 512 (July 29, 2024) requires competence (Rule 1.1) and candor (Rule 3.3). The Opinion states uncritical reliance is 'almost certainly malpractice.'
What is retrieval-augmented generation (RAG) and does it prevent hallucinations?
RAG systems search a document database first, retrieve relevant passages, then generate answers citing only retrieved text. This architecture significantly reduces hallucinations compared to pure generative models because the system can only cite passages it actually found. However, Stanford's study found even legal-specific tools using RAG-like approaches still showed 17-34% error rates due to misgrounding, misclassification, and retrieval failures. RAG reduces risk but doesn't eliminate the verification requirement.
How do I verify AI-generated legal citations quickly?
Five-minute verification workflow: 1) Search the citation in Google Scholar, CourtListener, or your paid database to confirm the case exists. 2) Open the actual opinion and locate the quoted passage. 3) Read surrounding paragraphs to confirm context supports the claim. 4) Check Shepard's or KeyCite for subsequent history (reversed, overruled, questioned). 5) Verify the court and jurisdiction match your needs. Free tools include Google Scholar for existence checks and CourtListener for full text.
What standing orders require AI disclosure in court filings?
Ropes & Gray's tracker documented 36 standing orders in mid-2024, growing to 681+ orders and rules across all 50 states and federal circuits by mid-2026. Over 300 federal judges have AI disclosure requirements. Key examples include Judge Brantley Starr (N.D. Texas, May 2023) requiring human verification certification, S.D.N.Y. disclosure requirements following Mata v. Avianca, N.D. California AI use statements, Fifth Circuit verification certificates, and Delaware Chancery requiring firm AI policies on public docket.
What are the technical causes of AI hallucinations in legal research?
Four main mechanisms: 1) Training data contamination where models learn citation patterns but not actual legal holdings, creating plausible-sounding but fake citations. 2) Retrieval failures where RAG systems misrank results or retrieve wrong passages. 3) Grounding failures where systems cite real cases for propositions they don't support. 4) Instruction misalignment where models prioritize fluent, confident text over factual accuracy. The result is citations that look perfect but fail verification.
Has anyone been disbarred for AI citation fraud?
As of August 2026, no lawyer has been fully disbarred solely for AI hallucination incidents, but several face ongoing disciplinary proceedings. Mata v. Avianca resulted in grievance committee referral with proceedings pending. Other cases have resulted in temporary suspensions, mandatory ethics training, supervised practice requirements, and public reprimands. The trend suggests as AI hallucination becomes a known problem, courts and bar associations are likely to impose harsher penalties including potential disbarment for egregious or repeat offenses.
AI That Cites Your Actual Documents — Not Fabricated Cases
Lawyer Assistant uses retrieval-augmented generation (RAG) architecture to prevent the hallucinations documented in this research. It searches your document collection and cites only passages it has actually retrieved from your files. Every answer includes source file and page number for instant verification. Works completely offline on Windows, macOS, and Linux.
Download for free