AI-Generated Voices Amplify Conspiracy Theories on TikTok

June 1, 2023

NewsGuard has discovered 17 TikTok accounts utilizing AI-generated voices to propagate conspiracy theories and falsehoods since June 2023. By September 25, 2023, these accounts accumulated over 336 million views and more than 14.5 million likes. Videos feature unfounded allegations targeting public figures such as Barack Obama, Oprah Winfrey, and Jamie Foxx.

This incident underscores the need for safe and secure AI practices. For those interested in shaping trustworthy AI governance and contributing to Project Cerebellum's AI incident database, JOIN US.

This incident aligns with the HISPI Project Cerebellum TAIM's Govern function as it highlights the importance of guardrails for AI to prevent misinformation amplification.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
tiktok-user-@e.news.tv, tiktok-user-@d.news.tv, tiktok-user-@drphilshowtv, tiktok-user-@ynewstv2023, tiktok-users
Alleged developer
elevenlabs
Alleged harmed parties
barack-obama, oprah-winfrey, jamie-foxx, joan-rivers, phil-mcgraw, yahoo!-news, e!-news, tiktok, general-public

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/568

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.