Addressing Racial Bias in Child Abuse Prediction Tool: Oregon's Move Towards Responsible AI
October 1, 2018
Oregon’s Department of Human Services (DHS) discontinued the use of its Safety at Screening Tool, which predicted the risk of child abuse investigations. The decision was made to address racial bias and improve racially equitable decision-making in line with the principles of trustworthy AI. This AI incident maps to the Govern function in HISPI Project Cerebellum Trusted AI Model (TAIM). Ready to help shape responsible AI? JOIN US
- Alleged deployer
- oregon-department-of-human-services
- Alleged developer
- oregon-department-of-human-services
- Alleged harmed parties
- children-of-minority-groups, families-of-minority-groups
Source
Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/238
Data source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.