MAP 1.6

Control

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

Facebook Feed Algorithms Exposed Low Digitally Skilled Users to More Disturbing Content

November 15, 2019

GAN Faces Deployed by The BL's Fake Account Network to Push Pro-Trump Content on Meta Platforms

November 12, 2019

HireVue's Facial Analysis Algorithms Alleged as Unfair and Deceptive Technology

November 6, 2019

Optum Algorithmic Health Risk Scores Reportedly Underestimated Black Patients' Needs

October 24, 2019

Opaque Fraud Detection Algorithm by the UK’s Department of Work and Pensions Allegedly Discriminated against People with Disabilities

October 15, 2019

Hive Box Facial-Recognition Locks Hacked by Fourth Graders Using Intended Recipient’s Facial Photo

October 9, 2019

Grab Tweaked Matchmaking Algorithm, Providing Preferential Treatment to Drivers Registered with Affiliated Car Rental Service

October 8, 2019

Thai Wallet App's Facial Recognition Errors Created Registration Issues for Government Programs

September 29, 2019

Waze Allegedly Frequently Routed Drivers through the Town of Los Gatos, Blocking Its Single Wildfire Escape Route

September 6, 2019

Detroit Police Wrongfully Arrested Black Man Due To Faulty Facial Recognition

July 31, 2019

Telegram Channels Allowed Users to Make Non-Consensual Deepfake Porn as Paid Service

July 11, 2019

Facebook Political Ad Delivery Algorithms Inferred Users' Political Alignment, Inhibiting Political Campaigns' Reach

July 10, 2019