UK Government AI Allegedly Targets Disproportionate Numbers of Certain Nationals for Fraud Review

December 6, 2021

The UK government's handling of AI-powered fraud detection systems has sparked widespread concern, as the evidence mounts that Bulgarian nationals are being unfairly targeted for review, with potentially devastating consequences for those affected. As the Home Office struggles to justify its flawed equality impact assessment, one thing is clear: nationality-based targeting in benefit fraud investigations is a pressing issue that demands immediate attention and reform. We will continue to investigate this story as more information becomes available, and we invite you to JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Various British government offices, Home Office, Department for Work and Pensions, British government
Alleged developer
Home Office, Department for Work and Pensions, British government
Alleged harmed parties
Romanians in the United Kingdom, Greeks in the United Kingdom, Bulgarians in the United Kingdom, British public, Albanians in the United Kingdom

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/611

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.