AI Beauty Judge Did Not Like Dark Skin
Sep 5, 2016
In 2016, an international beauty contest judged by AI software named Beauty.AI revealed a troubling trend: the majority of winners were whit...
Read moreValues Statement: We believe AI should cause no harm, but enhance the quality of human life, by proactively adopting our AI Governance framework.
Evidence-based Transparent For governance
AI Incidents
TAIM catalog Map Data source & citationRealPage Algorithm Allegedly Inflates Rents and Reduces Competition in Housing Market
Sep 1, 2016
The YieldStar algorithm, used by RealPage, is under investigation for enabling landlords to potentially collude on rent increases through da...
Read moreAmazon’s Experimental Hiring Tool Allegedly Displayed Gender Bias in Candidate Rankings
Aug 10, 2016
Between 2014 and 2017, Amazon developed an AI-powered recruiting tool that reportedly displayed gender bias in candidate rankings. Trained o...
Read moreCommon Biases of Vector Embeddings
Jul 21, 2016
A study by researchers from Boston University and Microsoft Research, New England revealed gender bias in the most commonly employed techniq...
Read moreTougher Turing Test Exposes Chatbots’ Stupidity (migrated to Issue)
Jul 14, 2016
The 2016 Winograd Schema Challenge underscores the boundaries of sophisticated AI systems, with these participating AI models only slightly...
Read moreSecurity Robot Rolls Over Child in Mall
Jul 12, 2016
On July 7, 2016, an autonomous security robot (Knightscope K5) encountered an unfortunate incident at the Stanford Shopping Center in Palo A...
Read moreTesla on AutoPilot Killed Driver in Crash in Florida while Watching Movie
Jul 1, 2016
A Tesla Model S equipped with autopilot collided with a white tractor-trailer on Highway US 27A in Williston, Florida, resulting in the driv...
Read moreA Collection of Tesla Autopilot-Involved Crashes
Jun 30, 2016
A review of several unrelated car crashes, some resulting in harm, has taken place while a Tesla's autopilot system was activated. These inc...
Read moreThe DAO Hack
Jun 17, 2016
On June 18, 2016, an exploit targeting a vulnerability in The Decentralized Autonomous Organization (The DAO) on the Ethereum blockchain led...
Read moreRobots in Japanese Hotel Annoyed Guests and Failed to Handle Simple Tasks
Jun 15, 2016
A series of complaints from guests at a Japanese hotel highlighted the inability of robots to handle basic tasks such as answering schedulin...
Read moreGame AI System Produces Imbalanced Game
Jun 2, 2016
Elite: Dangerous, a popular space-themed video game developed by Frontier Development, experienced an unforeseen incident when its AI system...
Read moreFacebook Ad-Approval Algorithm Allegedly Missed Fraudulent Ads via Simple URL Checks
Jun 2, 2016
Facebook's advertisement-approval algorithm has reportedly failed to implement basic checks for domain URLs, potentially exposing its users...
Read moreData source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.