WeChat’s Machine Translation Gave a Racist English Translation for the Chinese Term for “Black Foreigner”

October 10, 2017

WeChat's recent incident on its messaging app serves as a stark reminder of the importance of cultural sensitivity in AI-powered translations, where a single misstep can have far-reaching consequences. The platform's mistake highlights the need for ongoing evaluation and improvement of machine translation capabilities to ensure they are not perpetuating biases or stereotypes that can be deeply ingrained in users' perceptions. As WeChat continues to evolve its language processing technologies, this incident underscores the necessity of human oversight and review to prevent such errors from occurring in the future. And to support safer AI development, visit JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
WeChat
Alleged developer
WeChat
Alleged harmed parties
Black WeChat users

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/216

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.