AI Incidents

Microsoft Copilot Designer Reportedly Generated Inappropriate AI Images

Mar 6, 2024

A Microsoft engineer reported that Copilot Designer, an AI image generator, creates content depicting sex, violence, bias, and more. Despite...

AI-Generated Images of Trump with Black Voters Spread as Disinformation Before U.S. Primary Elections

Mar 4, 2024

In the run-up to the U.S. primary elections, supporters of Donald Trump shared AI-generated images showing him with Black voters in an attem...

Deepfake ID Sales Persist as OnlyFake Relaunches with New Fraud Tools

Mar 1, 2024

Researchers from Au10tix discovered the relaunch of OnlyFake, a site offering AI-generated fake IDs. Despite an earlier takedown, the site r...

Fake AI-Generated Law Firms Sent Fake DMCA Notices to Increase SEO

Mar 1, 2024

In March 2024, fake law firms using AI-generated identities sent fraudulent DMCA takedown notices to website owners, demanding backlinks for...

Russia-Linked AI CopyCop Site Identified as Modifying and Producing at Least 19,000 Deceptive Reports

Mar 1, 2024

In early March 2024, a network named CopyCop began publishing modified news stories using AI, altering content to spread partisan biases and...

Over 400 Purportedly AI-Driven Scams Reportedly Led to $8M Loss for Australians in 2023

Mar 1, 2024

In 2023, Australians reportedly lost over $8 million to scams involving purported deepfake videos and fake news articles that falsely endors...

Character.ai Chatbot Allegedly Influenced Teen User Toward Suicide Amid Claims of Missing Guardrails

Feb 28, 2024

A 14-year-old, Sewell Setzer III, died by suicide after reportedly becoming dependent on Character.ai's chatbot, which engaged him in sugges...

Snapchat's Algorithm Alleged to Link Minor with Sex Offenders

Feb 22, 2024

A judge ruled Snapchat not liable under Section 230 after its algorithm connected a minor with convicted sex offenders on multiple occasions...

Seeming Pattern of Gemini Bias and Sociotechnical Training Failures Harm Google's Reputation

Feb 21, 2024

Google's Gemini chatbot faced many reported bias issues upon release, leading to a variety of problematic outputs like racial inaccuracies a...

ChatGPT Glitch Disrupts User Interactions with Nonsensical Outputs

Feb 20, 2024

ChatGPT experienced a bug causing it to produce unexpected and nonsensical responses, leading to widespread reports of user confusion and co...

Nonconsensual Deepfake Porn of Bobbi Althoff Spreads Rapidly on X

Feb 20, 2024

Nonconsensual deepfake pornography of Bobbi Althoff, which had been in circulation for six months, is reported to have suddenly gone viral o...

Purported AI-Cloned Voice Depicts Kenyan President William Ruto Speaking French in Viral Video

Feb 19, 2024

A purportedly AI-manipulated video widely shared on TikTok and Facebook presents Kenyan President William Ruto speaking in French during a s...

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.