Manipulation of TikTok's For You Algorithm: Spreading Hate Under the Radar - A Case Study in Unchecked AI

January 15, 2022

TikTok's popular 'For You' algorithm is under scrutiny for its role in allegedly amplifying content from an online personality that promotes misogynistic views. This incident highlights the need for safe and secure AI, as well as responsible governance to prevent such harmful content from reaching impressionable audiences. This AI incident maps to the Govern function in HISPI Project Cerebellum Trusted AI Model (TAIM). Join us in shaping a more trustworthy future for AI - JOIN US.
Alleged deployer
tiktok
Alleged developer
tiktok
Alleged harmed parties
tiktok-male-teenager-users, tiktok-male-users, tiktok-teenage-users, tiktok-users, tiktok

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/300

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.