MEASURE 2.5

Control

The AI system to be deployed is demonstrated to be valid and reliable. Limitations of the generalizability beyond the conditions under which the technology was developed are documented.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

Purported AI-Generated Audio Was Reportedly Used to Claim Recep Tayyip Erdoğan Expressed Support for Imran Khan in Pakistani Parliament

February 15, 2025

AI Tools Reportedly Used to Fabricate Image of 5,000-Naira Nigerian Banknote Featuring President Bola Tinubu

January 26, 2025

NYC Subway AI Weapons Scanners Yield High False Positive Rate and Detect No Guns in Month-Long Pilot Test

October 23, 2024

Video with Reportedly AI-Generated Media Purported to Show Croatian Immunologist Stipan Jonjić Promoting Anti-Parasite Product on Facebook

August 27, 2024

Grok AI Model Reportedly Fails to Produce Reliable News in Wake of Trump Assassination Attempt

July 13, 2024

AI Work Assistants Require More Effort Than Expected, CIOs Say

June 25, 2024

ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

April 29, 2024

Gunshot Detection Technology ShotSpotter (now SoundThinking) Reportedly Only Has 47% Accuracy in Chicago System

January 31, 2024

AI Camera Allegedly Misidentifies Dutch Motorist as Using Mobile Phone, Issuing €380 Fine

October 31, 2023

University Student Reportedly Received Zero After Turnitin AI Detector Flagged Essay

July 24, 2023

Racial Bias in Lung Function Diagnostic Algorithm Leads to Underdiagnosis in Black Men

June 1, 2023

Apparent Failure to Accurately Label Primates in Image Recognition Software Due to Alleged Fear of Racial Bias

May 22, 2023