Alibaba's Ethnicity Detection Algorithm Incident: A Case for Trustworthy AI
An incident involving Alibaba Cloud's ethnicity detection algorithm has raised concerns about biased AI. This AI incident maps to the Govern...
Read moreValues Statement: We believe AI should cause no harm, but enhance the quality of human life, by proactively adopting our AI Governance framework.
Evidence-based Transparent For governance
AI Incidents
Data source & citationAI Alerts California Bar Exam to Potential Cheating in One-Third of Applications - Project Cerebellum
This AI incident highlights the critical role of trustworthy AI in maintaining integrity and fairness. The incident maps to the Govern funct...
Read moreTikTok Anorexia Content Using Obfuscated Hashtags Evades 'Pro-Ana' Filters
This AI incident highlights the challenges in content moderation on social media platforms, particularly TikTok. Obfuscation of keywords thr...
Read moreAccount Deletion of a Latina Trans Woman on TikTok Highlights Need for Responsible AI Governance
An incident involving the account deletion of a Latina trans woman on popular social media platform TikTok raises awareness about the import...
Read moreUnsafe AI Incident: Mall Robot Falls Off Escalator, Causes Injuries – Emphasizing Need for Responsible AI and Safety Measures
A recent incident involving a shopping mall robot falling off an escalator highlights the importance of trustworthy and safe AI. This AI inc...
Read moreExploring the Impact: The Case Study of an Admissions AI Algorithm
Delve into the implications of an admissions algorithm, understanding its role in shaping outcomes and its impact on fairness and transparen...
Read moreHow Brand Safety Tech Unintentionally Undermines the News Industry: A Case for Responsible AI
This case study highlights an unintended consequence of brand safety technology, which inadvertently defunds news organizations. This AI inc...
Read moreIsraeli Farmer vs. AI Algorithm: A Case Study in AI Governance
Explore the complexities of an Israeli farmer's disagreement with an algorithm, highlighting the importance of responsible AI and trustworth...
Read moreAI Software Misidentifies Students of Color, Highlighting the Need for Responsible AI
An incident involving an AI-powered testing software misidentifying students of color has raised concerns about the safety and reliability o...
Read moreVerifying E-commerce Platforms' Algorithms Against Vaccine Misinformation Spread
This AI incident highlights the need for robust algorithmic auditing in e-commerce platforms to prevent misinformation, particularly regardi...
Read moreExam Monitoring Software Disadvantaging BIPOC Students at the University of Toronto: A Case for Responsible AI Governance
This incident highlights potential disadvantages faced by Black, Indigenous, and People of Color (BIPOC) students using exam monitoring soft...
Read morePotential Use of Music in an AI Context: Analyzing the Beverly Hills Cop Incident
Investigating the potential use of music to evade live-streaming: A case study on the Beverly Hills Cop incident. This incident maps to the...
Read moreData source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.