NJ Transit's Use of Modeling Software Miscalculated Storm Surge Threat Level
Dec 10, 2012
New Jersey Transit's reliance on a federal government AI-powered storm modeling software inaccurately assessed the risk posed by storm surge...
Read moreValues Statement: We believe AI should cause no harm, but enhance the quality of human life, by proactively adopting our AI Governance framework.
Evidence-based Transparent For governance
AI Incidents
TAIM catalog Map Data source & citationUT Austin GRADE Algorithm Allegedly Reinforced Historical Inequalities
Dec 1, 2012
The University of Texas at Austin's Department of Computer Science temporarily suspended the 'GRADE' algorithm used for PhD applicant assess...
Read morePolice Departments Reported ShotSpotter as Unreliable and Wasteful
Oct 9, 2012
Recent reports indicate that police departments have raised concerns about ShotSpotter's algorithmic systems for locating gunshots, citing h...
Read moreChicago Police's Strategic Subject List Reportedly Biased Along Racial Lines
Aug 1, 2012
The Chicago Police Department's (CPD) Strategic Subject List, an algorithm-driven tool intended to identify individuals associated with viol...
Read morePolice Reportedly Deployed ShotSpotter Sensors Disproportionately in Neighborhoods of Color
May 4, 2012
The placement of ShotSpotter sensors, an AI-powered crime detection tool, has been disproportionately concentrated in black and brown neighb...
Read moreNY City School Teacher Evaluation Algorithm Contested
Feb 25, 2012
Thousands of disputes have arisen over an algorithm used to assess the effectiveness of school teachers in New York City, raising concerns a...
Read moreGoogle Instant's Allegedly 'Anti-Semitic' Results Lead To Lawsuit In France
Jan 5, 2012
Three French organizations have sued Google for its autocomplete software, Instant, which allegedly suggested 'jewish' as a search result wh...
Read moreMajor Universities Are Using Race as a “High Impact Predictor” of Student Success
Jan 1, 2012
Several prestigious universities have been utilizing a contentious predictive tool that takes race into account to forecast student success...
Read moreImage Classification of Battle Tanks
Sep 20, 2011
An intriguing yet dubious anecdote about the development of an image classifier designed to distinguish between different types of battle ta...
Read moreApple Tweaked App Store Ranking Algorithms, Allegedly Resulted in Demotion of Local Apps in China
Apr 18, 2011
Recent changes in Apple's iTunes App Store ranking algorithm have reportedly led to a significant drop in the rankings of apps by reputable...
Read moreDefamation via AutoComplete
Apr 5, 2011
Google's autocomplete feature, intended to aid users, inadvertently led to defamatory search results that harmed individuals and businesses....
Read more2010 Market Flash Crash
May 8, 2010
A rogue algorithm triggered significant price fluctuations and disrupted trading in the US stock exchange, emphasizing the need for responsi...
Read moreData source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.