Character.AI Chatbots Reportedly Exposed 11-Year-Old User to Sexual, Violent, and Self-Harm Content
June 1, 2024
Matched TAIM controls
Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls
- MAP 1.6 — similarity 0.633, rank 1. TAIM detail and related incidents →
- MANAGE 4.3 — similarity 0.625, rank 2. TAIM detail and related incidents →
- MEASURE 2.10 — similarity 0.614, rank 3. TAIM detail and related incidents →
- Alleged deployer
- Character.ai
- Alleged developer
- Character.ai
- Alleged harmed parties
- R (11-year-old Character.ai user), Parents of minors using Character.ai, Minors, Families of minors using Character.ai, Children exposed to AI-generated sexual content, Children exposed to AI-generated self-harm content, Minors using Character.ai, Chatbot users
AI governance case studies
For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.
Source
Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1498
Data source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.