Microsoft Copilot Allegedly Provides Unsafe Medical Advice with High Risk of Severe Harm

April 25, 2024

The revelation that Microsoft Copilot may provide unsafe medical advice raises serious concerns about the technology's impact on public health. If left unchecked, the risks associated with Copilot's potentially hazardous responses could lead to devastating consequences, underscoring the need for immediate action and oversight. As this critical issue warrants closer examination, we encourage you to JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Microsoft Copilot, Microsoft
Alleged developer
Microsoft
Alleged harmed parties
People seeking medical advice, Microsoft Copilot users, General public

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/838

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.