Chinese Insurer Ping An Employed Facial Recognition to Determine Customers’ Untrustworthiness, Which Critics Alleged to Likely Make Errors and Discriminate

April 15, 2016

Customers’ untrustworthiness and unprofitability were reportedly determined by Ping An, a large insurance company in China, via facial-recognition measurements of micro-expressions and body-mass indices (BMI), which critics argue was likely to make mistakes, discriminate against certain ethnic groups, and undermine its own industry.

This raises concerns about the use of facial recognition technology in decision-making processes, highlighting the need for careful consideration of potential biases and errors. The consequences of such actions can have far-reaching impacts on individuals and society as a whole. In an effort to promote accountability and transparency, it is essential to explore the implications of this technology and ensure that it is used responsibly.

As concerns surrounding Ping An's facial recognition system continue to grow, it is crucial that regulators and industry leaders take swift action to address these issues and establish clear guidelines for the responsible use of such technology in decision-making processes. The consequences of a single mistake or discriminatory incident can be severe, affecting not only the individuals involved but also eroding trust in the insurance industry as a whole. By acknowledging the potential risks and taking steps to mitigate them, we can ensure that this technology serves as a force for good, rather than perpetuating harm. And to stay updated on AI incidents, visit JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Ping An
Alleged developer
Ping An
Alleged harmed parties
Ping An customers, Chinese minority groups

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/235

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.