Facial Recognition Pilot in Bahia Reportedly Targeted Black and Poor People
Dec 1, 2018
A facial recognition pilot implemented by the local government of Bahia, reportedly displaying a minimal hit rate, has allegedly disproporti...
Read moreValues Statement: We believe AI should cause no harm, but enhance the quality of human life, by proactively adopting our AI Governance framework.
Evidence-based Transparent For governance
AI Incidents
TAIM catalog Map Data source & citation Failure Files™Schufa Credit Scoring in Germany Reported for Unreliable and Imbalanced Scores
Nov 28, 2018
A recent report has highlighted potential biases in the Schufa credit scoring system in Germany, suggesting older and female consumers as we...
Read moreReported Automated License Plate Reader Alert on Previously Stolen Rental Car Leads to Alleged Wrongful Detainment in California
Nov 23, 2018
An alleged instance of an automated license plate reader incorrectly flagging a previously recovered rental car in California resulted in a...
Read moreEmotion Detection Models Showed Disparate Performance along Racial Lines
Nov 9, 2018
A study reveals racial disparities in the performance of emotion detection models from Face++ and Microsoft's Face API, with these tools mor...
Read moreWrongful Attempted Arrest for Apple Store Thefts Due to NYPD’s Facial Misidentification
Nov 8, 2018
The New York Police Department (NYPD) incorrectly applied its facial recognition system, falsely linking a Black teenager to a series of the...
Read morePicture of Woman on Side of Bus Shamed for Jaywalking
Nov 6, 2018
A facial recognition system in China mistakenly identified a celebrity's face on a moving billboard as a jaywalker. This incident underscore...
Read moreCrashes with Maneuvering Characteristics Augmentation System (MCAS)
Oct 27, 2018
A Boeing 737 tragically crashed into the sea, claiming 189 lives, due to faulty sensor data causing the Maneuvering Characteristics Augmenta...
Read moreFacebook "News Feed" Allegedly Boosted Misinformation and Violating Content Following Use of MSI Metric
Oct 1, 2018
In early 2018, Facebook's News Feed algorithm overhaul resulted in a focus on engagement between friends and family. However, company resear...
Read moreOregon’s Screening Tool for Child Abuse Cases Discontinued Following Concerns of Racial Bias
Oct 1, 2018
The Oregon Department of Human Services (DHS) has discontinued its Safety at Screening Tool, a risk prediction tool used to forecast future...
Read moreDutch Families Wrongfully Accused of Tax Fraud Due to Discriminatory Algorithm
Sep 1, 2018
An algorithm-based childcare benefits system in the Netherlands has incorrectly flagged thousands of families for potential fraud, with seco...
Read moreFacebook Allegedly Failed to Police Anti-Rohingya Hate Speech Content That Contributed to Violence in Myanmar
Aug 15, 2018
Facebook is under scrutiny for its alleged failure to remove violent and dehumanizing anti-Rohingya hate speech content from its platform, r...
Read moreHUD charges Facebook with enabling housing discrimination
Aug 13, 2018
In March 2019, the U.S. Department of Housing and Urban Development accused Facebook of violating the Fair Housing Act by enabling real esta...
Read moreData source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.