Chicago Police's Strategic Subject List: A Questionable Algorithm for Safe and Secure AI
August 1, 2012
The Chicago Police Department's Strategic Subject List, an algorithm-driven tool designed to identify potential victims or perpetrators of violence, has reportedly shown ineffectiveness, vulnerability to abuse, and racial bias against low-income communities of color. This AI incident maps to the Govern function in HISPI Project Cerebellum Trusted AI Model (TAIM). Ready to contribute to trustworthy AI harm prevention? JOIN US
- Alleged deployer
- chicago-police-department
- Alleged developer
- chicago-police-department
- Alleged harmed parties
- low-income-communities, communities-of-color, black-chicago-residents
Source
Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/433
Data source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.