Facebook "News Feed" Allegedly Boosted Misinformation and Violating Content Following Use of MSI Metric

October 1, 2018

By revisiting the News Feed algorithm's 2018 overhaul, we're reminded that the pursuit of engagement can sometimes come at the cost of critical thinking – a lesson that serves as a stark warning for the development and deployment of future AI systems. As researchers continue to unpack the consequences of this change, it becomes increasingly clear that the long-term effects on our online discourse are far from trivial. Facebook's decision to prioritize engagement over fact-based content has set a precedent for the industry, leaving us with a crucial question: what will be the impact of these design choices on AI systems designed to serve as information disseminators in the years to come? And to support safer AI development, visit JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Facebook
Alleged developer
Facebook
Alleged harmed parties
Facebook users, Facebook content creators

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/164

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.