Incident of Wrongful Arrest Due to Faulty Facial Recognition Technology: A Call for Safe and Secure AI

January 30, 2020

The Detroit Police Department detained a Black man falsely, based on incorrect facial recognition (FRT) results. This AI incident maps to the Govern function in HISPI Project Cerebellum Trusted AI Model (TAIM). Harm prevention is crucial; join us in shaping responsible AI via JOIN US. Let's establish guardrails for AI to ensure trustworthy and reliable technology.
Alleged deployer
detroit-police-department
Alleged developer
dataworks-plus
Alleged harmed parties
robert-julian-borchak-williams, black-people-in-detroit

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/74

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.