Self-driving cars in winter
Feb 10, 2016
Ice-covered sensors during winter adversely affected the autonomous driving capabilities of a Volvo XC90 SUV in Jokkmokh, Sweden. This incid...
Read moreValues Statement: We believe AI should cause no harm, but enhance the quality of human life, by proactively adopting our AI Governance framework.
Evidence-based Transparent For governance
AI Incidents
TAIM catalog Map Data source & citationUber's Surge Pricing Reportedly Offered Disproportionate Service Quality along Racial Lines
Feb 3, 2016
Uber's surge-pricing algorithm, designed to adjust prices and influence car availability, unintentionally led to disproportionate service qu...
Read moreDutch City Court Defended Home Value Generated by Black-Box Algorithm
Feb 1, 2016
The Castricum court's decision to defend a home value generated by a black-box algorithm has sparked debate, with legal specialists cautioni...
Read moreA Tesla Crashed into and Killed a Road Sweeper on a Highway in China
Jan 20, 2016
A Tesla Model S collided with a road sweeper on a highway near Handan, China. The accident occurred despite previous statements by Tesla tha...
Read moreArkansas's Opaque Algorithm to Allocate Health Care Excessively Cut Down Hours for Beneficiaries
Jan 1, 2016
The Arkansas Department of Human Services (DHS) deployed an algorithm to boost efficiency in its Medicaid waiver program, reportedly causing...
Read moreAmazon Alexa Responding to Environmental Inputs
Dec 5, 2015
Multiple reports of Amazon Alexa devices (Echo, Echo Dot) have shown reactivity towards unintended stimuli such as television commercials or...
Read morePredictive Policing Biases of PredPol
Nov 18, 2015
Predictive policing algorithms, such as PredPol, aim to support law enforcement by forecasting potential crime hotspots. However, recent fin...
Read moreYouTube Recommendations Allegedly Promoted Radicalizing Material Contributing to Terrorist Acts
Nov 13, 2015
The family of Nohemi Gonzalez alleged that YouTube's recommendation systems inadvertently promoted propaganda videos for the Islamic State,...
Read moreInappropriate Gmail Smart Reply Suggestions
Nov 3, 2015
Google's Gmail Smart Reply tool was found suggesting the response 'I love you' in situations where it was considered inappropriate. This inc...
Read moreAmazon Flex Drivers Allegedly Fired via Automated Employee Evaluations
Sep 25, 2015
Amazon Flex drivers allege unfair dismissal due to automated employee performance evaluations with limited human intervention. These evaluat...
Read moreYouTube Recommendations Implicated in Political Radicalization of User
Sep 1, 2015
YouTube's personalization and recommendation algorithms are accused of contributing to the radicalization of young male users, promoting exp...
Read morePredictive Policing Program by Florida Sheriff’s Office Allegedly Violated Residents’ Rights and Targeted Children of Vulnerable Groups
Sep 1, 2015
The Intelligence-Led Policing model implemented by the Pasco County Sheriff’s Office is being scrutinized for potential misuse. Critics clai...
Read moreData source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.