Facebook’s and Twitter's Automated Content Moderation Reportedly Failed to Effectively Enforce Violation Rules for Small Language Groups

February 16, 2021

Facebook's and Twitter were unable to adequately moderate content from small language groups, such as those from the Balkan region, due to inadequate investment in human moderation and challenges in designing AI solutions for these languages. This issue highlights the need for more effective strategies to address the unique needs of diverse linguistic communities. The lack of investment in human moderation and AI solution design has resulted in a failure to enforce violation rules, leaving these groups vulnerable to online harm. And to stay updated on AI incidents, visit JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Twitter, Facebook
Alleged developer
Twitter, Facebook
Alleged harmed parties
Twitter users of small language groups, Facebook users of small language groups

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/143

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.