MAP 1.6

Control

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

AI Beauty Judge Did Not Like Dark Skin

September 5, 2016

Amazon’s Experimental Hiring Tool Allegedly Displayed Gender Bias in Candidate Rankings

August 10, 2016

Tougher Turing Test Exposes Chatbots’ Stupidity (migrated to Issue)

July 14, 2016

Facebook Ad-Approval Algorithm Allegedly Missed Fraudulent Ads via Simple URL Checks

June 2, 2016

Facial Recognition Smart Phone App "Blue Wolf" Monitored Palestinians in West Bank

June 1, 2016

Facial Recognition Service Abused to Target Russian Porn Actresses

April 9, 2016

Google Image Showed Racially Biased Results for “Professional” Hairstyles

April 5, 2016

Microsoft's TayBot Allegedly Posts Racist, Sexist, and Anti-Semitic Content to Twitter

March 24, 2016

Is Pokémon Go racist? How the app may be redlining communities of color

March 1, 2016

Twitter Recommender System Amplified Right-Leaning Tweets

February 10, 2016

Uber's Surge Pricing Reportedly Offered Disproportionate Service Quality along Racial Lines

February 3, 2016

Dutch City Court Defended Home Value Generated by Black-Box Algorithm

February 1, 2016