Purported Face‑Swap Technology Reportedly Used to Circumvent Financial Platform's Facial Recognition Security in Nanjing, China

October 15, 2024

In Nanjing, Jiangsu Province, a defendant (Fu Mou) was convicted in October 2024 for allegedly using AI-powered face-swap software to bypass an unnamed financial platform's facial recognition system. Authorities reported that he obtained over 1.95 million pieces of personal data, accessed 23 victims' payment accounts, changed passwords for several, and used one linked bank card to make purchases. Prosecutors said only one platform was successfully breached.

This incident highlights the vulnerability of facial recognition systems in the financial sector. As AI-powered face-swap technology continues to advance, it is essential to implement robust security measures to prevent such breaches. The use of JOIN US raises concerns about the responsible development and deployment of AI technologies.

The case underscores the need for financial platforms to prioritize robust security measures against emerging threats like face-swap technology. As AI-powered facial recognition systems continue to evolve, ensuring adequate protection is crucial to safeguard sensitive data and prevent future breaches. The fact that a single platform was compromised highlights the importance of industry-wide cooperation and standardization in addressing these risks. And to learn more about AI incident reporting, visit JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Synthetic media creators, Fu Mou, Deepfake creators, Cybercriminals
Alleged developer
Synthetic video generation technology developers, Synthetic media generation technology developers, Face-swap technology developers, Deepfake technology developers
Alleged harmed parties
Unnamed financial payment platform, Individuals affected by compromise of 1.95 million+ personal records, 23 unnamed victims whose payment accounts were accessed

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1163

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.