MAP 1.6

Control

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

FaceApp Racial Filters

April 25, 2017

Facebook Reportedly Outed Sex Workers through Friend Recommendations

April 15, 2017

Uber Locked Indian Drivers out of Accounts Allegedly Due to Facial Recognition Fails

March 13, 2017

ByteDance Allegedly Trained "For You" Algorithm Using Content Scraped without Consent from Other Social Platforms

January 15, 2017

“Amazon’s Choice” Algorithm Failed to Recommend Functional Products and Prone to Review Manipulation

December 15, 2016

Passport checker Detects Asian man's Eyes as Closed

December 7, 2016

AI Beauty Judge Did Not Like Dark Skin

September 5, 2016

Amazon's Experimental Hiring Tool Allegedly Displayed Gender Bias in Candidate Rankings

August 10, 2016

Facial Recognition Smart Phone App 'Blue Wolf' Reportedly Monitored Palestinians in the West Bank

June 1, 2016

Chinese Insurer Ping An Employed Facial Recognition to Determine Customers’ Untrustworthiness, Which Critics Alleged to Likely Make Errors and Discriminate

April 15, 2016

Facial Recognition Service Abused to Target Russian Porn Actresses

April 9, 2016

Microsoft's TayBot Allegedly Posts Racist, Sexist, and Anti-Semitic Content to Twitter

March 24, 2016