MAP 1.6

Objective

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

Clearview AI Algorithm Built on Photos Scraped from Social Media Profiles without Consent

June 15, 2017

BBC Reporter's Twin Brother Cracked HSBC's Voice ID Authentication

May 19, 2017

New York Detective Misused Woody Harrelson's Face to Perform Face Recognition Search

April 28, 2017

FaceApp Racial Filters

April 25, 2017

Facebook Reportedly Outed Sex Workers through Friend Recommendations

April 15, 2017

Social Media's Automated Word-Flagging without Context Shifted Content Creators' Language Use

March 15, 2017

Uber Locked Indian Drivers out of Accounts Allegedly Due to Facial Recognition Fails

March 13, 2017

Male College Freshman Allegedly Made Porn Deepfakes Using Female Friend's Face

March 1, 2017

ByteDance Allegedly Trained "For You" Algorithm Using Content Scraped without Consent from Other Social Platforms

January 15, 2017

PimEyes's Facial Recognition AI Allegedly Lacked Safeguards to Prevent Itself from Being Abused

January 1, 2017

Alexa Plays Pornography Instead of Kids Song

December 30, 2016

“Amazon’s Choice” Algorithm Failed to Recommend Functional Products and Prone to Review Manipulation

December 15, 2016