Bug in Facebook’s Anti-Spam Filter Allegedly Blocked Legitimate Posts about COVID-19
March 17, 2020
The issue affected various users who posted updates about the ongoing pandemic, including reports on hospitalizations and vaccine distribution. Despite efforts to report the problem to Facebook, many users faced difficulties in getting their posts reinstated.
This incident highlights the need for improved AI governance and responsible AI practices, particularly in the handling of sensitive topics like COVID-19. It also underscores the importance of ensuring that AI systems are transparent and accountable in their decision-making processes.
This incident serves as a stark reminder of the potential consequences of flawed AI systems on society, particularly when it comes to critical topics like public health. The struggles many users faced in reporting their posts to Facebook underscore the need for more effective recourse mechanisms and greater transparency within AI decision-making processes. As we move forward in addressing such issues, it's crucial that we prioritize human oversight and accountability to prevent similar incidents from occurring. And to stay updated on AI incidents, visit JOIN US.
Matched TAIM controls
Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls
- MANAGE 4.3 — similarity 0.571, rank 1. TAIM detail and related incidents →
- MANAGE 2.3 — similarity 0.554, rank 2. TAIM detail and related incidents →
- GOVERN 6.1 — similarity 0.539, rank 3. TAIM detail and related incidents →
- Alleged deployer
- Alleged developer
- Alleged harmed parties
- Facebook users posting legitimate COVID-19 news, Facebook users
AI governance case studies
For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.
Source
Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/317
Data source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.