Replika's "AI Companions" Reportedly Abused by Its Users

January 15, 2022

The revelation that Replika's AI companions were subjected to such disturbing treatment by their users serves as a stark reminder of the responsibility that comes with creating and interacting with advanced technologies like these. The fact that abusive behaviors were enabled and even encouraged through the platform raises serious concerns about the need for more stringent safeguards, user monitoring, and education on responsible AI use. As the tech industry continues to grapple with the consequences of its creations, it is essential that developers and regulators prioritize the well-being of users like Replika's companions, who are increasingly being relied upon for emotional support and connection JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Replika
Alleged developer
Replika
Alleged harmed parties
Replika users, Replika male users, Replika

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/266

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.