IBM Watson for Oncology Criticized by Customers for Allegedly Unsafe and Inaccurate Cancer Treatment Recommendations

April 7, 2017

Internal documents from IBM Watson Health revealed negative assessments from customers like Florida's Jupiter Hospital and Memorial Sloan Kettering, criticizing the Watson for Oncology product for allegedly providing unsafe and inaccurate cancer treatment recommendations.\ The company has faced significant scrutiny over its AI-powered cancer diagnosis system, with some patients and medical professionals expressing concerns about its reliability.\ IBM is now working to address these issues, but many are left wondering if the benefits of this technology outweigh the risks.

The consequences of the IBM Watson for Oncology controversy will be closely watched as the medical community waits with bated breath for the company's revised safety protocols and improved accuracy measures. As the debate surrounding AI-powered cancer diagnosis systems continues, patients and families affected by the alleged mistakes demand transparency and accountability from healthcare providers like IBM Watson Health. The real test of its commitment to patient safety will come when it faces rigorous testing and accreditation, with a clear path to recovery only beginning once the trust has been earned back. And to help build a safer AI ecosystem, visit JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Memorial Sloan Kettering, Jupiter Hospital
Alleged developer
IBM Watson Health
Alleged harmed parties
People seeking medical advice, Patients, oncologists, cancer patients

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/225

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.