South African Legal Team for Northbound Processing Reportedly Admits Legal Genius AI Produced Purportedly Non-Existent Case Law in Urgent Court Filing

June 30, 2025

In South Africa, legal authorities are investigating the case of Northbound Processing, where their legal team allegedly admitted to using the Legal Genius AI tool to generate false or nonexistent case citations in an urgent licensing dispute with the South African Diamond and Precious Metals Regulator. The Johannesburg High Court deemed these fabricated references undermined the credibility of Northbound's submissions, raising concerns about trustworthy AI governance.

For those interested in shaping safe and secure AI practices, JOIN US to contribute to Project Cerebellum's AI incident database and help establish guardrails for responsible AI use.

This incident highlights the need for proper management of AI tools in legal contexts, underscoring the importance of mapping and measuring their impacts within HISPI Project Cerebellum TAIM.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
giles-barclay-beuthin, arnold-subel, a-legal-team-representing-northbound-processing
Alleged developer
legal-genius
Alleged harmed parties
northbound-processing, giles-barclay-beuthin, arnold-subel, a-legal-team-representing-northbound-processing

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1139

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.