Autonomous Security Robot Collides with Toddler: A Case for Safe and Secure AI
Jul 12, 2016
On July 7, 2016, an incident involving a Knightscope K5 autonomous security robot occurred at the Stanford Shopping Center in Palo Alto, CA....
Read moreValues Statement: We believe AI should cause no harm, but enhance the quality of human life, by proactively adopting our AI Governance framework.
Evidence-based Transparent For governance
AI Incidents
Data source & citationFatal Tesla Autopilot Crash: Highlighting the Importance of Responsible AI Governance
Jul 1, 2016
A tragic incident occurred on Highway US 27A in Williston, Florida, where a Tesla Model S on autopilot collided with a tractor-trailer, resu...
Read moreTesla Autopilot Incidents Highlight Importance of Safe and Secure AI - Project Cerebellum
Jun 30, 2016
A series of unrelated car crashes involving Tesla's Autopilot system underscore the need for trustworthy AI. This AI incident maps to the Go...
Read moreThe DAO Hack: A Cautionary Tale of Vulnerabilities in Decentralized Autonomous Organizations
Jun 17, 2016
On June 18, 2016, a security breach in The Decentralized Autonomous Organization (The DAO) on the Ethereum blockchain led to an attacker ste...
Read moreJapanese Hotel Robots: Failure to Deliver Trustworthy AI Experience
Jun 15, 2016
Guests reported a series of issues with robots employed by a Japanese hotel, including the inability to answer scheduling questions or make...
Read moreFacebook's Ad Approval Algorithm: Lapse in URL Checks Could Lead to Fraudulent Ads - A Reminder for Responsible AI
Jun 2, 2016
Recent reports suggest Facebook's ad-approval algorithm may have overlooked simple checks for domain URLs, potentially exposing users to fra...
Read moreImbalanced Game AI Incident in Elite: Dangerous Highlights Importance of Responsible AI Governance
Jun 2, 2016
Elite: Dangerous, a popular videogame developed by Frontier Development, experienced an AI system malfunction following an expansion update....
Read moreFacial Recognition App Blue Wolf Monitored Palestinians: A Case Study on AI Incident Governance
Jun 1, 2016
The controversial surveillance program, Blue Wolf, deployed by the Israeli military in the West Bank, employed facial recognition and algori...
Read moreAutopilot Failure: Tesla Model S Crashes into Van on European Highway - An Incident Illustrating Need for Responsible AI
May 26, 2016
A distressing incident involving a Tesla Model S utilizing the Traffic-Aware Cruise Control (TACC) feature of Autopilot occurred on a Europe...
Read moreCOMPAS Algorithm: Assessing the Accuracy of Recidivism Prediction Tools - A Case for Safe and Secure AI
May 23, 2016
Correctional Offender Management Profiling for Alternative Sanctions (COMPAS), a widely-used recidivism risk-assessment algorithm, has been...
Read moreIncident: Bias in Northpointe Risk Models - Harm Prevention and Trustworthy AI
May 23, 2016
The Northpointe risk model, used within the penal system, exhibits unacceptable racial bias, as twice as likely to misclassify black individ...
Read moreChinese Insurer Ping An's Controversial Use of Facial Recognition: Potential for Errors, Discrimination, and Industry Damage
Apr 15, 2016
Critics raise concerns over Ping An, a Chinese insurance company's use of facial-recognition technology to assess customers' trustworthiness...
Read moreData source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.