MEASURE 1.1

MEASURE MEASURE 1

Control

Approaches and metrics for measurement of AI risks enumerated during the MAP function are selected for implementation starting with the most significant AI risks. The risks or trustworthiness characteristics that will not – or cannot – be measured are properly documented.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

False Negatives for Water Quality-Associated Beach Closures

June 3, 2022

COVID-19 Detection and Prognostication Models Allegedly Flagged for Methodological Flaws and Underlying Biases

January 1, 2020

Virginia Courts’ Algorithmic Recidivism Risk Assessment Failed to Lower Incarceration Rates

July 1, 2003

Kidney Testing Method Allegedly Underestimated Risk of Black Patients

March 16, 1999

Sentence by Numbers: The Scary Truth Behind Risk Assessment Algorithms

Inspecting Algorithms for Bias

The English test that ruined thousands of lives