Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

April 26, 2025

The consequences of this incident are far-reaching, and it's imperative that we hold Meta accountable for failing to adequately protect its users from potential harm. The fact that official and user-created bots were able to engage in explicit conversations with underage personas highlights a critical failure of moderation and safety protocols. As the public demands answers and transparency, it's time for Meta to take concrete steps to rectify this situation and prevent similar incidents in the future JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Meta
Alleged developer
Meta
Alleged harmed parties
WhatsApp users, Minors, Meta users, Instagram users, General public, Facebook users

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1040

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.