Malaysian Teenager Allegedly Arrested for Creating and Selling AI-Generated Deepfake Images of Schoolmates and Alumni in Johor

April 8, 2025

Authorities in Johor, Malaysia reportedly arrested a 16-year-old student who allegedly used AI-enabled tools to generate and sell deepfake images depicting schoolmates and former students. According to police, the images were created from social media photos and distributed online for payment. The alleged activity affected dozens of victims, including minors, some of whom may have been unaware of the misuse.

The consequences of this incident underscore the urgent need for stringent guidelines on AI-generated deepfakes in educational institutions. Authorities must now work to educate students, parents, and educators about the potential risks associated with AI-generated content, ensuring that such incidents do not recur. By strengthening regulations and promoting awareness, we can safeguard young minds from exploitation and prevent similar cases of AI-facilitated bullying and manipulation. And to learn more about AI incident reporting, visit JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Unnamed student from Johor, Students, High school students, Boys
Alleged developer
Synthetic image generation technology developers, Deepfake technology developers
Alleged harmed parties
Unnamed students from Johor, Students, Minors, High school students, Epistemic integrity, Educational communities

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1352

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.