Automated Adult Content Detection Tools Showed Bias against Women Bodies

February 25, 2006

The discovery of bias against women's bodies in automated adult content detection tools has far-reaching implications for the representation and diversity of female voices online. As these tools continue to shape our online experiences, it is crucial that developers prioritize fair and inclusive AI practices to ensure that all forms of expression are treated with respect. By acknowledging and addressing this issue, we can work towards creating a more equitable online environment where diverse perspectives are valued and amplified JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Meta, LinkedIn, Instagram, Facebook
Alleged developer
Microsoft, Google, Amazon
Alleged harmed parties
LinkedIn users, Instagram users, Facebook users

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/469

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.