Chinese Insurer Ping An Employed Facial Recognition to Determine Customers’ Untrustworthiness, Which Critics Alleged to Likely Make Errors and Discriminate
April 15, 2016
This raises concerns about the use of facial recognition technology in decision-making processes, highlighting the need for careful consideration of potential biases and errors. The consequences of such actions can have far-reaching impacts on individuals and society as a whole. In an effort to promote accountability and transparency, it is essential to explore the implications of this technology and ensure that it is used responsibly.
As concerns surrounding Ping An's facial recognition system continue to grow, it is crucial that regulators and industry leaders take swift action to address these issues and establish clear guidelines for the responsible use of such technology in decision-making processes. The consequences of a single mistake or discriminatory incident can be severe, affecting not only the individuals involved but also eroding trust in the insurance industry as a whole. By acknowledging the potential risks and taking steps to mitigate them, we can ensure that this technology serves as a force for good, rather than perpetuating harm. And to stay updated on AI incidents, visit JOIN US.
Matched TAIM controls
Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls
- MEASURE 1.3 — similarity 0.605, rank 1. TAIM detail and related incidents →
- MEASURE 4.2 — similarity 0.603, rank 2. TAIM detail and related incidents →
- MAP 3.2 — similarity 0.602, rank 3. TAIM detail and related incidents →
- Alleged deployer
- Ping An
- Alleged developer
- Ping An
- Alleged harmed parties
- Ping An customers, Chinese minority groups
AI governance case studies
For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.
Source
Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/235
Data source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.