MEASURE 2.5

Control

The AI system to be deployed is demonstrated to be valid and reliable. Limitations of the generalizability beyond the conditions under which the technology was developed are documented.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

NYC Subway AI Weapons Scanners Yield High False Positive Rate and Detect No Guns in Month-Long Pilot Test

October 23, 2024

Joint Base Elmendorf-Richardson Soldier Faces Allegations of Using AI to Generate Child Pornography

August 23, 2024

TikTok AI System Used to Amplify Election Disinformation by Foreign Networks

August 8, 2024

Department for Work and Pensions (DWP) AI Systems Allegedly Discriminate Against Single Mothers

July 10, 2024

ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

April 29, 2024

Purportedly AI-Powered 007TG Platform Reportedly Used by Scam Networks Linked to $75 Million in Proceeds

April 1, 2024

Gunshot Detection Technology ShotSpotter (now SoundThinking) Reportedly Only Has 47% Accuracy in Chicago System

January 31, 2024

Racial Bias in Lung Function Diagnostic Algorithm Leads to Underdiagnosis in Black Men

June 1, 2023

Apparent Failure to Accurately Label Primates in Image Recognition Software Due to Alleged Fear of Racial Bias

May 22, 2023

False Arrest of Georgia Man Due to Louisiana Police's Faulty Facial Recognition Technology

November 25, 2022

Stable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn

August 17, 2022

Hiring Algorithms Provided Invalid Positive Results for Interview Responses in German

July 1, 2021