Job Screening Service Halts Facial Analysis of Applicants
Nov 6, 2019
In January 2021, HireVue decided to discontinue the use of its AI expression tracking tool from its virtual job interview software. This mov...
Read moreValues Statement: We believe AI should cause no harm, but enhance the quality of human life, by proactively adopting our AI Governance framework.
Evidence-based Transparent For governance
AI Incidents
TAIM catalog Map Data source & citationHireVue's Facial Analysis Algorithms Alleged as Unfair and Deceptive Technology
Nov 6, 2019
The hiring algorithms employed by HireVue, which incorporate facial analysis and personality estimation, have been accused in a complaint as...
Read moreOptum Algorithmic Health Risk Scores Reportedly Underestimated Black Patients' Needs
Oct 24, 2019
A study on an Optum algorithm, widely used by a major academic hospital, revealed potential bias towards underestimating the healthcare need...
Read moreOpaque Fraud Detection Algorithm by the UK’s Department of Work and Pensions Allegedly Discriminated against People with Disabilities
Oct 15, 2019
The UK’s Department of Work and Pensions is under scrutiny following allegations that its benefit fraud detection algorithm disproportionate...
Read moreHive Box Facial-Recognition Locks Hacked by Fourth Graders Using Intended Recipient’s Facial Photo
Oct 9, 2019
An express delivery locker company in China, Hive Box, encountered a security lapse as fourth-graders bypassed facial-recognition locks usin...
Read moreGrab Tweaked Matchmaking Algorithm, Providing Preferential Treatment to Drivers Registered with Affiliated Car Rental Service
Oct 8, 2019
Grab Indonesia was penalized by the Indonesian Competition Commission (KPPU) for unfairly prioritizing drivers associated with the affiliate...
Read moreKnightscope's Park Patrol Robot Ignored Bystander Pressing Emergency Button to Alert Police about Fight
Oct 4, 2019
An instance occurred in Huntington Park, California where a Knightscope K5 autonomous 'police' robot failed to react when an onlooker activa...
Read moreThai Wallet App's Facial Recognition Errors Created Registration Issues for Government Programs
Sep 29, 2019
A popular Thai wallet app encountered issues with facial recognition, impeding citizens—particularly the elderly—from registering for the go...
Read moreWaze Allegedly Frequently Routed Drivers through the Town of Los Gatos, Blocking Its Single Wildfire Escape Route
Sep 6, 2019
Residents of Los Gatos accused the Waze app of increasing wildfire hazard risk by routing weekend beach-going drivers through their neighbor...
Read moreTesla Model 3 on Autopilot Crashed into a Ford Explorer Pickup, Killing a Fifteen-Year-Old in California
Aug 24, 2019
A Tesla Model 3, operating in Autopilot mode, collided with a Ford Explorer pickup on a California freeway. According to data and video from...
Read moreDetroit Police Wrongfully Arrested Black Man Due To Faulty Facial Recognition
Jul 31, 2019
A disturbing incident occurred in Detroit where a Black man was wrongfully detained by the police department due to a faulty facial recognit...
Read moreTelegram Channels Allowed Users to Make Non-Consensual Deepfake Porn as Paid Service
Jul 11, 2019
A network of seven Telegram channels enables paid subscribers to create non-consensual deepfake nude images using bots from submitted photos...
Read moreData source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.