FBI Reported Surge of Extortion Cases of AI Media Featuring Sexual Explicit Activities

April 1, 2023

The FBI reported an increase in sextortion cases featuring the use of fake, including AI-generated, images or videos created from content posted on their social media sites or web postings, provided to the malicious actor upon request, or captured during video chats. This has led to a rise in victims being coerced into sharing explicit material, with the perpetrators using tactics such as threatening to release the content online unless their demands are met. The FBI warns that AI-generated media can be particularly convincing and difficult to distinguish from real images or videos.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Sextortionists, Scammers, Blackmailers
Alleged developer
Deepfake technology developers
Alleged harmed parties
Victims of sextortion, Teenagers targeted in sextortion scams

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/551

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.