Google Bard Allegedly Generated Fake Legal Citations in Michael Cohen Case

December 12, 2023

Michael Cohen, former lawyer for Donald Trump, claims to have used Google Bard, an AI chatbot, to generate legal case citations. These false citations were unknowingly included in a court motion by Cohen's attorney, David M. Schwartz. The AI's misuse highlights emerging risks in legal technology, as AI-generated content increasingly infiltrates professional domains.

The incident serves as a stark warning to lawyers and legal professionals about the potential risks of AI-generated content, particularly when it comes to complex and high-stakes cases like those involving Michael Cohen's court motion. As this case demonstrates, even well-intentioned AI tools can be misused, resulting in serious consequences. Google Bard's involvement raises fundamental questions about accountability and responsibility in AI-powered legal applications; for more information on this incident, go to JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Michael Cohen, David M. Schwartz
Alleged developer
Google Bard, Google
Alleged harmed parties
Michael Cohen, David M. Schwartz

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/623

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.