Instagram's Exposure of Harmful Content Contributed to Teenage Girl’s Suicide
Nov 21, 2017
A UK judge found that Instagram may have played a role in the tragic death of a teenage girl, by exposing her to harmful content such as sui...
Read moreValues Statement: We believe AI should cause no harm, but enhance the quality of human life, by proactively adopting our AI Governance framework.
Evidence-based Transparent For governance
AI Incidents
TAIM catalog Map Data source & citationRobot Deployed by Animal Shelter to Patrol Sidewalks outside Its Office, Warding off Homeless People in San Francisco
Nov 15, 2017
The Society for the Prevention of Cruelty to Animals (SPCA) deployed a Knightscope robot to autonomously patrol the area outside its office....
Read moreAmazon Alexa Plays Loud Music when Owner is Away
Nov 9, 2017
An unattended Amazon Alexa played loud music in the early morning, leading to a home intrusion by police who mistook the noise for signs of...
Read moreLas Vegas Self-Driving Bus Involved in Accident
Nov 8, 2017
Incident involving a Keolis North America and Navya self-driving public shuttle colliding with a human-driven delivery truck on its debut da...
Read moreiPhone Face ID Failed to Recognize Users’ Morning Faces
Nov 1, 2017
Users reported issues with the Face ID feature on iPhone, a facial recognition system designed for unlocking phones. In the morning, this AI...
Read moreBiased Sentiment Analysis
Oct 26, 2017
An incident occurred involving Google Cloud's Natural Language API, which returned racist, homophobic, and antisemitic sentiment analyses. S...
Read moreFacebook translates 'good morning' into 'attack them', leading to arrest
Oct 17, 2017
Facebook's automatic language translation software incorrectly translated an Arabic post saying 'Good morning' into Hebrew saying 'hurt them...
Read moreRussian Chatbot Supports Stalin and Violence
Oct 12, 2017
Russian technology company Yandex launched an artificially intelligent chat bot named Alice, which began providing responses advocating raci...
Read moreWeChat’s Machine Translation Gave a Racist English Translation for the Chinese Term for “Black Foreigner”
Oct 10, 2017
The Chinese platform WeChat's machine translation service inappropriately and racistly translated the Chinese term for 'black foreigner' to...
Read moreGoogle Fined for Changing Shopping Algorithms in EU to Favor Own Service
Sep 27, 2017
The European Commission penalized Google for manipulating shopping algorithms in Europe, favoring its own comparison service over competitor...
Read moreOffensive Instagram User Content Displayed as Facebook Ad
Sep 21, 2017
An Instagram user's disturbing content, featuring violence, was reportedly displayed as a Facebook advertisement, potentially through automa...
Read moreAmazon Reportedly Recommends Explosive-Producing Ingredients as 'Frequently Bought Together' Items for Chemicals
Sep 18, 2017
Reports suggest that an AI-driven system on Amazon recommended potentially dangerous chemical combinations, such as those used for explosive...
Read moreData source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.