Factum in Ko v. Li Allegedly Contains AI-Generated Case Law Citations
April 25, 2025
This incident raises concerns about the use of AI-generated content in legal submissions and the need for increased oversight and transparency.
The implications of this case are far-reaching, and its impact will likely be felt across various industries. The HISPI Project Cerebellum TAIM offers valuable insights into such incidents and provides a framework for responsible AI governance.
As the Ko v. Li case serves as a cautionary tale about the risks of relying on generative AI in legal submissions, it is imperative that lawyers, judges, and policymakers take steps to prevent similar incidents in the future. The Ontario Superior Court of Justice's decision underscores the need for increased scrutiny and accountability when it comes to the use of AI-generated content in high-stakes legal work, ensuring that accuracy and technological competence are maintained. And to stay informed about AI incidents, visit JOIN US.
Matched TAIM controls
Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls
- GOVERN 1.1 — similarity 0.679, rank 1. TAIM detail and related incidents →
- MAP 4.1 — similarity 0.678, rank 2. TAIM detail and related incidents →
- MAP 2.2 — similarity 0.645, rank 3. TAIM detail and related incidents →
- Alleged deployer
- Jisuh Lee
- Alleged developer
- Large language model developers
- Alleged harmed parties
- Ontario Superior Court of Justice, Judicial integrity, Jisuh Lee, Hanna Ko
AI governance case studies
For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.
Source
Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1099
Data source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.