Google Healthcare AI Model Med‑Gemini Allegedly Produces Non‑Existent 'Basilar Ganglia' Term in Published Output

May 6, 2024

Google’s Med‑Gemini healthcare AI reportedly produced the non‑existent term "basilar ganglia" in public launch materials, conflating two distinct brain structures. The error reportedly appeared in both a blog post and an arXiv preprint. Google is reported to have initially edited the blog without acknowledgment, later calling it a typo.

The controversy surrounding Med-Gemini's incorrect reference to "basilar ganglia" serves as a stark reminder of the importance of rigorous testing and peer review in the development of complex healthcare technologies. As AI models like Med-Gemini continue to be deployed in high-stakes medical applications, it is crucial that developers prioritize accuracy and transparency. By acknowledging and addressing such errors promptly, organizations can build trust with their users and stakeholders, ensuring that these powerful tools are used for the betterment of human health. Google will host a discussion about AI governance and responsible innovation at JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Google
Alleged developer
Google
Alleged harmed parties
Patients whose care could be affected by undetected AI hallucinations, Medical research community citing or using erroneous AI outputs, Healthcare professionals relying on AI‑generated diagnostic content

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1164

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.