South African Court Found Self-Represented Litigant Relied on an AI-Hallucinated Judgment
January 29, 2026
The incident highlights the potential risks of relying on unverifiable sources, including AI-generated content. As the use of AI continues to evolve, it is essential to establish clear guidelines and regulations to ensure its responsible use in the legal system.
The Johannesburg court's ruling serves as a stark reminder of the need for caution when relying on AI-generated information, particularly in high-stakes legal proceedings. The consequences of trusting unverifiable sources can be severe, and it is crucial that we acknowledge the importance of fact-checking and verification in our pursuit of justice. As we move forward with the integration of AI into our judicial system, it is imperative that we prioritize transparency, accountability, and robust regulations to safeguard the integrity of our courts. And to stay updated on AI incidents, visit JOIN US.
Matched TAIM controls
Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls
- MAP 4.1 — similarity 0.664, rank 1. TAIM detail and related incidents →
- GOVERN 1.1 — similarity 0.651, rank 2. TAIM detail and related incidents →
- GOVERN 6.1 — similarity 0.637, rank 3. TAIM detail and related incidents →
- Alleged deployer
- Pro se litigants, Adriaan Johannes Roux
- Alleged developer
- Large language model developers, AI-assisted legal drafting system developers
- Alleged harmed parties
- Parties to legal proceedings, Judicial integrity, High Court of South Africa, Gauteng Division, Johannesburg, High Court of South Africa, Epistemic integrity, Courts
AI governance case studies
For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.
Source
Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1773
Data source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.