MAP 1.6

Control

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

Research Prototype AI, Delphi, Reportedly Gave Racially Biased Answers on Ethics

October 22, 2021

Student-Developed Facial Recognition App Raised Ethical Concerns

October 21, 2021

North Carolina Psychiatrist Used Artificial Intelligence to Produce Images of Child Sex Abuse

August 1, 2021

State Farm Allegedly Discriminated against Black Customers in Claim Payout

June 12, 2021

Kannada Insulted by Google's Featured Answer as "Ugliest Language in India"

June 3, 2021

Facebook, Instagram, and Twitter Cited Errors in Automated Systems as Cause for Blocking pro-Palestinian Content on Israeli-Palestinian Conflict

May 23, 2021

Replika's AI Partners Reportedly Sexually Harassed Users

May 18, 2021

Israeli Tax Authority Reportedly Used an Opaque Automated System to Issue a Fine, Declining to Explain or Disclose the Underlying Calculation

January 11, 2021

XPeng Motors Fined For Illegal Collection of Consumers’ Faces Using Facial Recognition Cameras

January 1, 2021

FaceApp Predicted Different Genders for Similar User Photos with Slight Variations

December 24, 2020

Korean Chatbot Luda Reportedly Made Offensive Remarks Towards Minority Groups in South Korea

December 23, 2020

Alibaba Cloud Developed Facial Recognition to Profile Muslim Uyghur Minorities

December 16, 2020