MAP 1.6

Objective

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

HUD charges Facebook with enabling housing discrimination

August 13, 2018

Amazon Allegedly Tweaked Search Algorithm to Boost Its Own Products

August 1, 2018

Amazon's Rekognition Falsely Matched Members of Congress to Mugshots

July 26, 2018

Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

July 20, 2018

Transgender Uber Drivers Mistakenly Kicked off App for Appearance Change during Gender Transitions

July 4, 2018

Facebook’s Automated Content Moderation Tool Flagged a Post Containing Parts of the Declaration of Independence as Hate Speech by Mistake

July 2, 2018

Calgary Malls Deployed Facial Recognition without Customer Consent

June 1, 2018

Amazon Echo Mistakenly Recorded and Sent Private Conversation to Random Contact

May 11, 2018

Amazon Allegedly Violated Children's Privacy through Default Voice Collection Settings

May 10, 2018

Facebook’s Automated Removal of Content Featuring Nudity-Containing Artworks Denounced as Censorship

May 1, 2018

Content Using Bestiality Thumbnails Allegedly Evaded YouTube’s Thumbnail Monitoring System

April 23, 2018

Investigative Journalist Rana Ayyub Targeted by AI-Generated Deepfake Pornography

April 20, 2018