MAP 1.6

Control

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

New Jersey Police Wrongful Arrested Innocent Black Man via FRT

January 30, 2019

Tumblr Automated Pornography-Detecting Algorithms Erroneously Flagged Inoffensive Images as Explicit

December 3, 2018

Facial Recognition Pilot in Bahia Reportedly Targeted Black and Poor People

December 1, 2018

Reported Automated License Plate Reader Alert on Previously Stolen Rental Car Leads to Alleged Wrongful Detainment in California

November 23, 2018

Wrongful Attempted Arrest for Apple Store Thefts Due to NYPD’s Facial Misidentification

November 8, 2018

Picture of Woman on Side of Bus Shamed for Jaywalking

November 6, 2018

Facebook "News Feed" Allegedly Boosted Misinformation and Violating Content Following Use of MSI Metric

October 1, 2018

Facebook Allegedly Failed to Police Anti-Rohingya Hate Speech Content That Contributed to Violence in Myanmar

August 15, 2018

HUD charges Facebook with enabling housing discrimination

August 13, 2018

Amazon Allegedly Tweaked Search Algorithm to Boost Its Own Products

August 1, 2018

Amazon's Rekognition Falsely Matched Members of Congress to Mugshots

July 26, 2018

Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

July 20, 2018