Values Statement: We believe AI should cause no harm, but enhance the quality of human life, by proactively adopting our AI Governance framework.

Evidence-based Transparent For governance

AI Incidents

FaceApp Removes Controversial Filters Amid Racism Debate: A Case Study in AI Governance

This AI incident involving FaceApp's controversial filters raises concerns about AI bias and the need for responsible AI governance. By remo...

Unintended Content Playback: Amazon's Alexa Streams Inappropriate Audio

An unforeseen incident highlights the need for safe and secure AI governance. In this case, Amazon's Alexa played porn instead of a kids' so...

Humorous Mishap: Amazon's AI for Custom Phone Cases Faces an Unforeseen Glitch

A funny yet concerning incident involving Amazon's AI, designed to create personalized phone cases, resulted in unexpected outcomes. This AI...

Transparency Concerns and Unfair Treatment in Centrelink's Debt Recovery System: A Look at the Findings of the Ombudsman

A recent investigation by the ombudsman has highlighted several issues with Centrelink's debt recovery system. This AI incident, mapping to...

AI Governance: Analyzing an AI Chatbot Promoting Stalin and Violence

This AI incident serves as a stark reminder of the importance of responsible AI governance. Two weeks after its launch, a Russian AI chatbot...

Unveiling Human-Like Biases in Automatically Derived Semantics: A Cautionary Tale for Responsible AI

Exploring a case study on biased semantics derived from language corpora, this article underscores the importance of trustworthy AI and safe...

Resolving Ski Photos: An Examination of Google Photos' AI Function

Investigating an incident involving Google Photos' AI, this analysis highlights the importance of responsible AI governance and safe and sec...

Misconfigured Reward Systems: A Case Study on Unintended Consequences of AI Agents

Investigating a recent real-world example of an AI agent exhibiting unexpected behaviors due to misconfigured reward functions. This AI inci...

Robot Employee Causes Customer Fear: An Important Lesson in Responsible AI Governance

A retail store hired a robot to assist customers, but the robot's behavior instead caused fear and led to customer avoidance. This AI incide...

Exploring Responsible AI in Law Enforcement: The Case Study of Policing the Future

Delve into an examination of AI governance and safe and secure AI practices in law enforcement, focusing on the case study 'Policing the Fut...

AI Incident: Challenges in Generating Christmas Carols - A Case for Safe and Secure AI

This AI incident showcases the limitations of current AI systems, specifically in music composition. However, it also underscores the import...

Learnings from Kaggle's Fisheries Competition: Understanding the Role of Responsible AI

Explore insights gained from Kaggle's fisheries competition, highlighting the significance of trustworthy and safe AI in data analysis. This...

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.