MAP 1.6

Control

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

Ever AI Reportedly Deceived Customers about FRT Use in App

April 1, 2019

Tumblr Automated Pornography-Detecting Algorithms Erroneously Flagged Inoffensive Images as Explicit

December 3, 2018

Amazon Allegedly Tweaked Search Algorithm to Boost Its Own Products

August 1, 2018

Calgary Malls Deployed Facial Recognition without Customer Consent

June 1, 2018

Amazon Echo Mistakenly Recorded and Sent Private Conversation to Random Contact

May 11, 2018

Amazon Allegedly Violated Children's Privacy through Default Voice Collection Settings

May 10, 2018

Facebook’s Automated Removal of Content Featuring Nudity-Containing Artworks Denounced as Censorship

May 1, 2018

Facial Recognition Program in São Paulo Metro Stations Suspended for Illegal and Disproportionate Violation of Citizens’ Right to Privacy

April 12, 2018

Instagram's Exposure of Harmful Content Contributed to Teenage Girl’s Suicide

November 21, 2017

Amazon Alexa Plays Loud Music when Owner is Away

November 9, 2017

WeChat’s Machine Translation Gave a Racist English Translation for the Chinese Term for “Black Foreigner”

October 10, 2017

Google Fined for Changing Shopping Algorithms in EU to Favor Own Service

September 27, 2017