Alleged Unsafe and Inaccurate Recommendations by IBM Watson for Oncology: A Case Study in AI Incidents

April 7, 2017

Recent internal documents have revealed criticism from notable healthcare institutions like Florida’s Jupiter Hospital and Memorial Sloan Kettering towards IBM Watson Health's Watson for Oncology product. This incident highlights the need for safe, accurate, and trustworthy AI in healthcare, a key focus of Project Cerebellum's AI governance efforts. Ready to help shape responsible AI? JOIN US This AI incident maps to the Govern function in HISPI Project Cerebellum Trusted AI Model (TAIM).
Alleged deployer
jupiter-hospital, memorial-sloan-kettering
Alleged developer
ibm-watson-health
Alleged harmed parties
oncologists, cancer-patients

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/225

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.