Dubious Facial Recognition Pilot in Bahia: Disparate Impact on Black and Low-Income Populations

December 1, 2018

A facial recognition pilot project implemented by the local government of Bahia, reportedly with a minimal hit rate, appears to have disproportionately affected Black and low-income individuals. This incident maps to the Govern function in HISPI Project Cerebellum Trusted AI Model (TAIM). JOIN US: Help us ensure safe and secure AI by joining our community and supporting responsible AI governance.
Alleged deployer
the-government-in-bahia, bahia's-secretary-of-public-security
Alleged developer
huawei
Alleged harmed parties
black-people-in-brazil, black-people-in-bahia

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/388

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.