AI Incidents

Data source & citation

OMFG My 10 year old just asked Alexa on our Echo for a challenge and this is what she said.

Discrimination through optimization: How Facebook's ad delivery can lead to skewed outcomes

The English test that ruined thousands of lives

Ohio Sues Meta Alleging Facebook Parent Misled Public About Its Products’ Effect on Children

Facebook Tried to Make Its Platform a Healthier Place. It Got Angrier Instead.

What a machine learning tool that turns Obama white can (and can’t) tell us about AI bias

This girls-only app uses AI to screen a user’s gender — what could go wrong?

Why Stanford Researchers Tried to Create a ‘Gaydar’ Machine

Popularity Bias in Collaborative Filtering-Based Multimedia Recommender Systems

Rohingya refugees sue Facebook for $150 billion over Myanmar violence

Target didn’t figure out a teen girl was pregnant before her father did

Driver Fined After Traffic Camera Thinks Pedestrian’s Shirt Is a License Plate

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.