OpenDream AI Platform Reportedly Commercialized AI-Generated CSAM and Non-consensual Deepfake Sexual Images

December 1, 2023

OpenDream, an AI image generation platform operated by CBM Media Pte Ltd, was reportedly used to generate and monetize AI-produced child sexual abuse material (CSAM) and non-consensual deepfakes through its public gallery and NSFW tools. The content remained publicly accessible and searchable for months before any moderation took place in mid-2024. Subsequent actions included takedowns by Google and Bing, as well as the termination of ad and payment services.

This incident underscores the need for safe and secure AI practices and robust governance. Join us at HISPI Project Cerebellum to help shape harm prevention guardrails for AI incidents such as this one through our Measure function.
JOIN US

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
opendream-users, opendream
Alleged developer
cbm-media-pte-ltd
Alleged harmed parties
victims-of-non-consensual-deepfakes, minors, general-public, children

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1335

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.