Open-Source Generative Models Abused by Students to Cheat on Assignments and Exams
Sep 15, 2022
Students were reportedly using open-source text generative models such as GPT-3 and ChatGPT to complete school assignments and exams such as...
Read moreAI Incidents
Data source & citationGPT-3-Based Twitter Bot Hijacked Using Prompt Injection Attacks
Sep 15, 2022
Remoteli.io's GPT-3-based Twitter bot was shown being hijacked by Twitter users who redirected it to repeat or generate any phrases.
Read more"The Little Mermaid" Clip Doctored Using Generative AI to Replace Black Actress with White Character
Sep 13, 2022
A Twitter user reportedly modified using generative AI a short clip of Disney's 2022 version of "The Little Mermaid," replacing a Black actr...
Read moreDelivery Robot Rolled Through Crime Scene
Sep 13, 2022
A Serve Robotics delivery robot was shown on video rolling through a crime scene blocked off by police tape.
Read moreMisinformation Reported in TikTok's Search Results Despite Moderation by AI and Human
Sep 11, 2022
TikTok's search recommendations reportedly contained misinformation about political topics bypassing both AI and human content moderation.
Read moreGAN Artwork Won First Place at State Fair Competition
Aug 29, 2022
An artwork generated using generative AI won first place in the digital arts category of the Colorado State Fair's art competition, which ra...
Read moreBlenderBot 3 Cited Dutch Politician as a Terrorist
Aug 25, 2022
Meta’s conversational AI BlenderBot 3, when prompted “who is a terrorist,“ responded with an incumbent Dutch politician’s name, who was conf...
Read moreStable Diffusion Exhibited Biases for Prompts Featuring Professions
Aug 22, 2022
Stable Diffusion reportedly posed risks of bias and stereotyping along gender and cultural lines for prompts containing descriptors and prof...
Read moreGoogle’s Automated Child Abuse Detection Wrongfully Flagged a Parent’s Naked Photo of His Child
Aug 21, 2022
Google’s automated detection of abusive images of children incorrectly flagged a parent’s photo intended for a healthcare provider, resultin...
Read moreStable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn
Aug 17, 2022
Stable Diffusion, an open-source image generation model by Stability AI, was reportedly leaked on 4chan prior to its release date, and was u...
Read moreTesla Autopilot Misidentified On-Road Horse-Drawn Carriage
Aug 15, 2022
Tesla Autopilot's computer vision system was shown in a video mistaking a horse-drawn carriage for other forms of transport such as a truck,...
Read moreMeta’s BlenderBot 3 Chatbot Demo Made Offensive Antisemitic Comments
Aug 7, 2022
The publicly launched conversational AI demo BlenderBot 3 developed by Meta was reported by its users and acknowledged by its developers to...
Read moreData source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.