TikTok’s "For You" Allegedly Pushed Fatal “Blackout” Challenge Videos to Two Young Girls

February 26, 2021

TikTok's recommendation algorithm was alleged in a lawsuit to have intentionally and repeatedly pushed videos of the “blackout– challenge onto children's feeds, incentivizing their participation which ultimately resulted in the death of two young girls. This incident raises serious concerns about the lack of responsible AI practices on social media platforms.

The incident highlights the need for stricter regulations on algorithmic decision-making and increased transparency in AI-driven content recommendations. It also underscores the importance of prioritizing user safety and well-being, particularly when it comes to minors.

The consequences of this incident will be felt for a long time to come, as the world grapples with the devastating impact of social media algorithms on our children's lives. The fact that two young girls lost their lives due to the reckless promotion of harmful content by TikTok's "For You" algorithm is a stark reminder of the need for stricter regulations and more responsible AI practices in social media platforms, which can be found at JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
TikTok
Alleged developer
TikTok
Alleged harmed parties
TikTok young users, TikTok users, Lalani Erika Renee Walton's family, Lalani Erika Renee Walton, Arriani Jaileen Arroyo's family, Arriani Jaileen Arroyo

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/286

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.