MEASURE 2.5

Control

The AI system to be deployed is demonstrated to be valid and reliable. Limitations of the generalizability beyond the conditions under which the technology was developed are documented.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

Year-long AI Surveillance Pilot in Two South Australian Aged Care Facilities Reportedly Overwhelmed Staff with False Positives

March 1, 2021

Queensland Man Allegedly Distributed Purportedly AI-Generated Sexual Posters Falsely Advertising Women for Sex

February 1, 2021

High False Positive Rate by SWP's Facial Recognition Use at Champion's League Final

June 3, 2017

Government Deployed Extreme Surveillance Technologies to Monitor and Target Muslim Minorities in Xinjiang

October 1, 2016

Amazon's Experimental Hiring Tool Allegedly Displayed Gender Bias in Candidate Rankings

August 10, 2016

Tougher Turing Test Exposes Chatbots’ Stupidity (migrated to Issue)

July 14, 2016

Police Departments Reported ShotSpotter as Unreliable and Wasteful

October 9, 2012

Google has ‘fixed’ its algorithm that categorised people as 'Gorillas' with a not so elegant solution

Google Photos identified black people as 'gorillas,' but racist software isn't new

Security researchers show Google's anti-internet troll AI platform is easily deceived

Even algorithms are biased against black men

Yes, artificial intelligence can be racist