Factum in Ko v. Li Allegedly Contains AI-Generated Case Law Citations

April 25, 2025

In Ko v. Li, 2025 ONSC 2766, the Ontario Superior Court of Justice identified multiple inaccurate or nonexistent case citations in a factum submitted by counsel for the applicant. Justice FL Myers questioned whether generative AI was used in drafting the document, noting the cited cases were either irrelevant, misrepresented, or did not exist. The court ordered the lawyer to show cause why she should not be cited for contempt, citing duties of accuracy and technological competence.

This incident raises concerns about the use of AI-generated content in legal submissions and the need for increased oversight and transparency.
The implications of this case are far-reaching, and its impact will likely be felt across various industries. The HISPI Project Cerebellum TAIM offers valuable insights into such incidents and provides a framework for responsible AI governance.

As the Ko v. Li case serves as a cautionary tale about the risks of relying on generative AI in legal submissions, it is imperative that lawyers, judges, and policymakers take steps to prevent similar incidents in the future. The Ontario Superior Court of Justice's decision underscores the need for increased scrutiny and accountability when it comes to the use of AI-generated content in high-stakes legal work, ensuring that accuracy and technological competence are maintained. And to stay informed about AI incidents, visit JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Jisuh Lee
Alleged developer
Large language model developers
Alleged harmed parties
Ontario Superior Court of Justice, Judicial integrity, Jisuh Lee, Hanna Ko

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1099

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.