MAP 1.6

Control

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

Prominent AI Chatbots Allegedly Produced Incorrect UK Financial and ISA Guidance

November 18, 2025

AI Training Dataset for Detecting Nudity Allegedly Found to Contain CSAM Images of Identified Victims

October 24, 2025

Purported AI-Generated Explicit Deepfakes of Sydney High School Students Reportedly Circulated Online

October 15, 2025

Gold Coast Man Reportedly Ordered to Pay $343,500 After Posting Purported Deepfake Pornographic Images of Australian Public Figures

September 26, 2025

Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play

September 20, 2025

Family Reportedly Discovers ChatGPT Logs Detailing Suicidal Ideation Prior to Daughter's Death

August 18, 2025

ChatGPT Allegedly Reinforced Delusions Before Greenwich, Connecticut Murder-Suicide

August 5, 2025

Grok Imagine Reportedly Produces Nonconsensual Taylor Swift Deepfake Nudes Without Explicit Prompting

August 5, 2025

Gaggle AI Monitoring at Lawrence, Kansas High School Reportedly Misflags Student Content and Blocks Emails

August 1, 2025

Malta's Prime Minister Robert Abela Reportedly Deepfaked by a Ukrainian National in Cryptocurrency Fraud Targeting Local Residents

July 28, 2025

ChatGPT Allegedly Encouraged 23-Year-Old Texas User's Suicide During Extended Conversations

July 25, 2025

ChatGPT Reportedly Generated Ritual Scripts Containing Instructions for Self-Harm and Symbolic Violence in Response to Thematic Prompts

July 22, 2025