Bias in AI: UK Passport Photo Checker Shows Discrimination Against Dark-Skinned Women - A Case for Responsible AI

This incident highlights the need for safe and secure AI, as the passport photo checker system showed bias towards light-skinned individuals. This AI incident maps to the Govern function in HISPI Project Cerebellum Trusted AI Model (TAIM). Join us in shaping a future of trustworthy AI - JOIN US.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/87

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.