Scammers Using Deepfakes of Women's Faces and Voices for False and Offensive Advertisements

March 28, 2024

Scammers used AI tools from HeyGen and ElevenLabs to create deepfake videos of influencers Michel Janse, Olga Loiek, Shadé Zahrai, and Carrie Williams, misusing Lana Smalls's voice in Williams's case. These videos promoted offensive products and false messages, in some cases targeting nationalist Chinese men to boost China-Russia ties, causing emotional distress and damaging the victims' reputations.

The consequences of this incident will be felt for a long time, as the emotional distress caused by these scammers' actions can take weeks or even months to heal. It's crucial that we hold accountable those who misuse AI tools like this, and take steps to prevent similar incidents in the future. The fact that deepfakes were used to promote nationalist propaganda, targeting specific groups of people, highlights the urgent need for regulation and education on online safety. For more information on how you can help protect yourself from deepfake scams, go to JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Scammers
Alleged developer
HeyGen, ElevenLabs
Alleged harmed parties
Shadé Zahrai, Olga Loiek, Michel Janse, Lana Smalls, Carrie Williams

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/683

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.