Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain

July 26, 2007

The devastating consequences of misclassified low-risk cases highlight the urgent need for transparency and accountability in AI-driven systems like VioGén. By understanding the root causes of this error, policymakers can work towards developing more effective safeguards against similar incidents in the future. Spain's government must now take concrete steps to review and revise its algorithms to prevent such tragedies from occurring again, ensuring that victims of gender violence receive the support they deserve. Spain will learn from its mistakes and we want you to JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Spanish Ministry of Interior, Law enforcement, Government of Spain
Alleged developer
Spanish Secretary of State for Security, Spanish Ministry of Interior, Law enforcement, Government of Spain
Alleged harmed parties
Women and girls, Women, Victims of gender violence in Spain, Victims of gender violence, Victims of domestic abuse, Minors, General public of Spain, General public

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/186

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.