TikTok’s "For You" Allegedly Pushed Fatal “Blackout” Challenge Videos to Two Young Girls
February 26, 2021
The incident highlights the need for stricter regulations on algorithmic decision-making and increased transparency in AI-driven content recommendations. It also underscores the importance of prioritizing user safety and well-being, particularly when it comes to minors.
The consequences of this incident will be felt for a long time to come, as the world grapples with the devastating impact of social media algorithms on our children's lives. The fact that two young girls lost their lives due to the reckless promotion of harmful content by TikTok's "For You" algorithm is a stark reminder of the need for stricter regulations and more responsible AI practices in social media platforms, which can be found at JOIN US.
Matched TAIM controls
Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls
- GOVERN 6.1 — similarity 0.551, rank 1. TAIM detail and related incidents →
- MAP 5.1 — similarity 0.541, rank 2. TAIM detail and related incidents →
- MANAGE 2.3 — similarity 0.536, rank 3. TAIM detail and related incidents →
- Alleged deployer
- TikTok
- Alleged developer
- TikTok
- Alleged harmed parties
- TikTok young users, TikTok users, Lalani Erika Renee Walton's family, Lalani Erika Renee Walton, Arriani Jaileen Arroyo's family, Arriani Jaileen Arroyo
AI governance case studies
For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.
Source
Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/286
Data source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.