Facial Recognition Smart Phone App "Blue Wolf" Monitored Palestinians in West Bank
Jun 1, 2016
The Israeli military deployed a contentious AI-powered surveillance program called Blue Wolf, which employs facial recognition and algorithm...
Read moreValues Statement: We believe AI should cause no harm, but enhance the quality of human life, by proactively adopting our AI Governance framework.
Evidence-based Transparent For governance
AI Incidents
TAIM catalog Map Data source & citationTesla on Autopilot TACC Crashed into Van on European Highway
May 26, 2016
A Tesla Model S, utilizing its Traffic-Aware Cruise Control (TACC) feature within the Autopilot system, was involved in a collision with a s...
Read moreNorthpointe Risk Models
May 23, 2016
A risk scoring algorithm developed by Northpointe, utilized within the penal system, demonstrates twice the likelihood of misclassifying a b...
Read moreCOMPAS Algorithm Reportedly Performs Poorly in Crime Recidivism Prediction
May 23, 2016
Correctional Offender Management Profiling for Alternative Sanctions (COMPAS), an algorithmic tool used in the judicial system, has been fou...
Read moreChinese Insurer Ping An Employed Facial Recognition to Determine Customers’ Untrustworthiness, Which Critics Alleged to Likely Make Errors and Discriminate
Apr 15, 2016
Ping An, a prominent Chinese insurance company, has been under scrutiny due to its implementation of facial-recognition technology to evalua...
Read moreFacial Recognition Service Abused to Target Russian Porn Actresses
Apr 9, 2016
The facial recognition service FindFace, which enables users to correlate images with individuals' social media profiles on Vkontakte, has b...
Read moreGoogle Image Showed Racially Biased Results for “Professional” Hairstyles
Apr 5, 2016
Google Image search reportedly displayed racially biased results, demonstrating a significant disparity between the representation of profes...
Read moreUnreliable ShotSpotter Audio Convicted Black Rochester Man of Shooting Police
Apr 1, 2016
ShotSpotter's questionable audio, serving as scientific evidence, led to a wrongful conviction of a Black man accused of attempting to shoot...
Read moreBiased Google Image Results
Mar 31, 2016
On June 6, 2016, a concerning incident of racial bias was uncovered in Google's image search algorithm. Searches for 'three black teenagers'...
Read moreMicrosoft's TayBot Allegedly Posts Racist, Sexist, and Anti-Semitic Content to Twitter
Mar 24, 2016
Microsoft's Tay, an AI chatbot launched on March 23, 2016, was removed within a day due to inappropriate racist, sexist, and anti-semitic co...
Read moreIs Pokémon Go racist? How the app may be redlining communities of color
Mar 1, 2016
The popular smartphone game Pokemon Go was found to have a disproportionate concentration of augmented reality locations in predominantly wh...
Read moreTwitter Recommender System Amplified Right-Leaning Tweets
Feb 10, 2016
An internal study by Twitter revealed a potential bias in its 'Home' timeline algorithm, amplifying tweets and news of right-wing politician...
Read moreData source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.