South African Court Found Self-Represented Litigant Relied on an AI-Hallucinated Judgment

January 29, 2026

A self-represented litigant's reliance on a nonexistent AI-generated judgment has been found by a Johannesburg court, raising concerns about the use of artificial intelligence in legal proceedings.

The incident highlights the potential risks of relying on unverifiable sources, including AI-generated content. As the use of AI continues to evolve, it is essential to establish clear guidelines and regulations to ensure its responsible use in the legal system.

The Johannesburg court's ruling serves as a stark reminder of the need for caution when relying on AI-generated information, particularly in high-stakes legal proceedings. The consequences of trusting unverifiable sources can be severe, and it is crucial that we acknowledge the importance of fact-checking and verification in our pursuit of justice. As we move forward with the integration of AI into our judicial system, it is imperative that we prioritize transparency, accountability, and robust regulations to safeguard the integrity of our courts. And to stay updated on AI incidents, visit JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Pro se litigants, Adriaan Johannes Roux
Alleged developer
Large language model developers, AI-assisted legal drafting system developers
Alleged harmed parties
Parties to legal proceedings, Judicial integrity, High Court of South Africa, Gauteng Division, Johannesburg, High Court of South Africa, Epistemic integrity, Courts

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1773

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.