High-Toxicity Assessed on Text Involving Women and Minority Groups

February 27, 2017

The findings from this incident highlight the urgent need for AI developers to critically assess their tools' biases and take concrete steps towards mitigating harm. By understanding how Google's Perspective API assigns higher toxicity scores to certain phrases, we can work towards creating more inclusive and equitable AI practices that prioritize fairness over flawed algorithms. As we move forward in addressing these issues, it is essential to engage with experts and advocacy groups who are already pushing for change – let us join the conversation at JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Google
Alleged developer
Google
Alleged harmed parties
Women and girls, Women, Minority groups

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/13

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.