Warehouse robot ruptures can of bear spray and injures workers
Dec 5, 2018
Twenty-four workers were hospitalized after an AI-controlled robot in a New Jersey Amazon warehouse accidentally punctured a can of bear rep...
Read moreValues Statement: We believe AI should cause no harm, but enhance the quality of human life, by proactively adopting our AI Governance framework.
Evidence-based Transparent For governance
AI Incidents
TAIM catalog Map Data source & citationTumblr Automated Pornography-Detecting Algorithms Erroneously Flagged Inoffensive Images as Explicit
Dec 3, 2018
Tumblr's automated filters designed to identify adult content have been reported to incorrectly classify innocuous images as explicit, after...
Read moreSleeping Driver on Tesla AutoPilot
Dec 1, 2018
A Tesla Model S incident occurred when the driver, under the influence of alcohol, fell asleep while the vehicle was in autopilot mode. The...
Read moreFacial Recognition Pilot in Bahia Reportedly Targeted Black and Poor People
Dec 1, 2018
A facial recognition pilot implemented by the local government of Bahia, reportedly displaying a minimal hit rate, has allegedly disproporti...
Read moreSchufa Credit Scoring in Germany Reported for Unreliable and Imbalanced Scores
Nov 28, 2018
A recent report has highlighted potential biases in the Schufa credit scoring system in Germany, suggesting older and female consumers as we...
Read moreReported Automated License Plate Reader Alert on Previously Stolen Rental Car Leads to Alleged Wrongful Detainment in California
Nov 23, 2018
An alleged instance of an automated license plate reader incorrectly flagging a previously recovered rental car in California resulted in a...
Read moreEmotion Detection Models Showed Disparate Performance along Racial Lines
Nov 9, 2018
A study reveals racial disparities in the performance of emotion detection models from Face++ and Microsoft's Face API, with these tools mor...
Read moreWrongful Attempted Arrest for Apple Store Thefts Due to NYPD’s Facial Misidentification
Nov 8, 2018
The New York Police Department (NYPD) incorrectly applied its facial recognition system, falsely linking a Black teenager to a series of the...
Read morePicture of Woman on Side of Bus Shamed for Jaywalking
Nov 6, 2018
A facial recognition system in China mistakenly identified a celebrity's face on a moving billboard as a jaywalker. This incident underscore...
Read moreCrashes with Maneuvering Characteristics Augmentation System (MCAS)
Oct 27, 2018
A Boeing 737 tragically crashed into the sea, claiming 189 lives, due to faulty sensor data causing the Maneuvering Characteristics Augmenta...
Read moreOregon’s Screening Tool for Child Abuse Cases Discontinued Following Concerns of Racial Bias
Oct 1, 2018
The Oregon Department of Human Services (DHS) has discontinued its Safety at Screening Tool, a risk prediction tool used to forecast future...
Read moreFacebook "News Feed" Allegedly Boosted Misinformation and Violating Content Following Use of MSI Metric
Oct 1, 2018
In early 2018, Facebook's News Feed algorithm overhaul resulted in a focus on engagement between friends and family. However, company resear...
Read moreData source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.