MAP 1.6

Objective

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

WeChat’s Machine Translation Gave a Racist English Translation for the Chinese Term for “Black Foreigner”

October 10, 2017

Offensive Instagram User Content Displayed as Facebook Ad

September 21, 2017

AI-Assisted Body Scanners Reportedly Subjected Transgender Travelers to Invasive Body Searches

September 15, 2017

Hackers Break Apple Face ID

September 13, 2017

Identical Twins Can Open Apple FaceID Protected Devices

September 13, 2017

Researchers' Homosexual-Men Detection Model Denounced as a Threat to LGBTQ People’s Safety and Privacy

September 7, 2017

"Jewish Baby Strollers" Provided Anti-Semitic Google Images, Allegedly Resulting from Hate Speech Campaign

August 15, 2017

"Jewish Baby Strollers" Provided Anti-Semitic Google Images, Allegedly Resulting from Hate Speech Campaign

August 15, 2017

'Jewish Baby Strollers' Provided Antisemitic Google Images, Allegedly Resulting from Hate Speech Campaign

August 15, 2017

AI-Designed Phone Cases Are Unexpected

July 10, 2017

Deepfake Obama Introduction of Deepfakes

July 1, 2017

Airbnb's Trustworthiness Algorithm Allegedly Banned Users without Explanation, and Discriminated against Sex Workers

July 1, 2017