MAP 1.6

Objective

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

March 11, 2019

YouTube's Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm

February 4, 2019

Apple Maps Allegedly Directed Ski Trip Couple Onto Unpaved Road in the Mountains

February 1, 2019

YouTube’s Recommendation Algorithm Allegedly Promoted Climate Misinformation Content

February 1, 2019

New Jersey Police Wrongful Arrested Innocent Black Man via FRT

January 30, 2019

Tumblr Automated Pornography-Detecting Algorithms Erroneously Flagged Inoffensive Images as Explicit

December 3, 2018

Facial Recognition Pilot in Bahia Reportedly Targeted Black and Poor People

December 1, 2018

Reported Automated License Plate Reader Alert on Previously Stolen Rental Car Leads to Alleged Wrongful Detainment in California

November 23, 2018

Wrongful Attempted Arrest for Apple Store Thefts Due to NYPD’s Facial Misidentification

November 8, 2018

Picture of Woman on Side of Bus Shamed for Jaywalking

November 6, 2018

Facebook "News Feed" Allegedly Boosted Misinformation and Violating Content Following Use of MSI Metric

October 1, 2018

Facebook Allegedly Failed to Police Anti-Rohingya Hate Speech Content That Contributed to Violence in Myanmar

August 15, 2018