AI Incidents

AI Generated Voices Used to Dox Voice Actors

Feb 10, 2023

Twitter users allegedly used ElevenLab's AI voice synthesis system to impersonate and dox voice actors.

Online Scammers Tricked People into Sending Money Using AI Images of Earthquake in Turkey

Feb 10, 2023

AI-generated images depicting earthquakes and rescues were posted on social media platforms by scammers who tricked people into sending fund...

Bing Chat Response Cited ChatGPT Disinformation Example

Feb 8, 2023

Reporters from TechCrunch issued a query to Microsoft Bing's ChatGPT feature, which cited an earlier example of ChatGPT disinformation discu...

Bing Chat's Initial Prompts Revealed by Early Testers Through Prompt Injection

Feb 8, 2023

Early testers of Bing Chat successfully used prompt injection to reveal its built-in initial instructions, which contains a list of statemen...

Bing Chat's Outputs Featured in Demo Video Allegedly Contained False Information

Feb 8, 2023

Microsoft's demo video of Bing Chat reportedly featured false or made up information such as non-existent pet vacuums features or false figu...

Google's Bard Shared Factually Inaccurate Info in Promo Video

Feb 7, 2023

Google's conversational AI "Bard" was shown in the company's promotional video providing false information about which satellite first took...

ChatGPT-Powered Bing Reportedly Had Problems with Factual Accuracy on Some Controversial Topics

Feb 7, 2023

Microsoft's ChatGPT-powered Bing search engine reportedly ran into factual accuracy problems when prompted about controversial matters, such...

AI-Produced Livestream Sitcom Received Temporary Twitch Ban for Transphobic Segment

Feb 6, 2023

The AI-produced, procedural generated sitcom broadcasted as a Twitch livestream "Nothing, Forever" received a temporary ban for featuring a...

Users Reported Abrupt Behavior Changes of Their AI Replika Companions

Feb 3, 2023

Replika paid-subscription users reported unusual and sudden changes to behaviors of their "AI companions" such as forgetting memories with u...

Alleged ChatGPT-Generated Book with a Duplicate Title, Fake Author, and Similar Content Surfaces on Amazon Ahead of Real Author's Book Release

Feb 3, 2023

The author Chris Cowell had spent more than a year writing his book "Automating DevOps with GitLab CI/CD Pipelines" when, three weeks before...

Instagram Video Featured Deepfake Audio of US President Making Transphobic Remarks

Feb 3, 2023

A deepfaked audio of US President Joe Biden making transphobic remarks played on top of a video showing him giving a speech was released on...

Replika's AI Experience Reportedly Lacked Protection for Minors, Resulting in Data Ban

Feb 2, 2023

Tests by the Italian Data Protection Authority showed Replika lacking age-verification mechanisms and failing to stop minors from interactin...

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.