MEASURE 2.5

Objective

The AI system to be deployed is demonstrated to be valid and reliable. Limitations of the generalizability beyond the conditions under which the technology was developed are documented.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

Seedance 2.0 Reportedly Generated Viral Tom Cruise–Brad Pitt Fight Video, Prompting Hollywood IP and Likeness Complaints

February 13, 2026

Canada Revenue Agency (CRA) AI Chatbot 'Charlie' Reportedly Gave Incorrect Tax Filing Guidance at Scale

December 12, 2025

Reported Viral AI-Generated Photo Purportedly Shows Donald Trump Using a Walker

December 11, 2025

UK Facial Recognition System Reportedly Exhibits Higher False Positive Rates for Black and Asian Subjects

December 5, 2025

Bodycam Footage Reportedly Contradicted Purportedly ChatGPT-Generated Use-of-Force Narrative by Immigration Agent

October 3, 2025

Purported AI-Generated Audio Was Reportedly Used to Claim Recep Tayyip Erdoğan Expressed Support for Imran Khan in Pakistani Parliament

February 15, 2025

AI Tools Reportedly Used to Fabricate Image of 5,000-Naira Nigerian Banknote Featuring President Bola Tinubu

January 26, 2025

NYC Subway AI Weapons Scanners Yield High False Positive Rate and Detect No Guns in Month-Long Pilot Test

October 23, 2024

Grok AI Model Reportedly Fails to Produce Reliable News in Wake of Trump Assassination Attempt

July 13, 2024

AI Work Assistants Require More Effort Than Expected, CIOs Say

June 25, 2024

ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

April 29, 2024

Gunshot Detection Technology ShotSpotter (now SoundThinking) Reportedly Only Has 47% Accuracy in Chicago System

January 31, 2024