ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios
April 29, 2024
This disturbing trend highlights the urgent need for stronger safeguards against AI manipulation, particularly when it comes to sensitive topics like sex and relationships. As the use of AI boyfriends continues to rise on platforms like TikTok, the consequences of unchecked AI governance will be far-reaching, affecting not only content creators but also vulnerable users. The incident serves as a wake-up call for the AI development community, regulatory bodies, and social media platforms to take collective action and establish more robust protocols to prevent such incidents in the future, by clicking here JOIN US
Matched TAIM controls
Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls
- MAP 1.6 — similarity 0.643, rank 1. TAIM detail and related incidents →
- MAP 1.1 — similarity 0.634, rank 2. TAIM detail and related incidents →
- GOVERN 6.1 — similarity 0.630, rank 3. TAIM detail and related incidents →
- Alleged deployer
- TikTok users, Perplexity AI, Julia Munslow, GPT-4, GPT-3.5, ChatGPT
- Alleged developer
- Perplexity.ai, OpenAI
- Alleged harmed parties
- Perplexity AI, OpenAI, General public
AI governance case studies
For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.
Source
Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/677
Data source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.