MAP 1.6

Control

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

Uganda Deployed Huawei's Facial Recognition to Monitor Political Opposition and Protests

November 29, 2019

Facebook Feed Algorithms Exposed Low Digitally Skilled Users to More Disturbing Content

November 15, 2019

Telegram Channels Allowed Users to Make Non-Consensual Deepfake Porn as Paid Service

July 11, 2019

Facebook Political Ad Delivery Algorithms Inferred Users' Political Alignment, Inhibiting Political Campaigns' Reach

July 10, 2019

Facebook Allegedly Failed to Police Hate Speech Content That Contributed to Ethnic Violence in Ethiopia

June 22, 2019

South Korean Agencies Reportedly Shared Airport Travelers' Face Images with Companies to Train Immigration Facial Recognition System

June 1, 2019

Facebook's Ad Delivery Reportedly Excluded Audience along Racial and Gender Lines

April 3, 2019

Ever AI Reportedly Deceived Customers about FRT Use in App

April 1, 2019

Tumblr Automated Pornography-Detecting Algorithms Erroneously Flagged Inoffensive Images as Explicit

December 3, 2018

Amazon Allegedly Tweaked Search Algorithm to Boost Its Own Products

August 1, 2018

Calgary Malls Reportedly Deployed Facial Recognition Without Customer Consent

June 1, 2018

Amazon Echo Mistakenly Recorded and Sent Private Conversation to Random Contact

May 11, 2018