MAP 1.6

Control

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

Israeli Tax Authority Reportedly Used an Opaque Automated System to Issue a Fine, Declining to Explain or Disclose the Underlying Calculation

January 11, 2021

Hawaii Police Deployed Robot Dog to Patrol a Homeless Encampment

January 10, 2021

XPeng Motors Fined For Illegal Collection of Consumers’ Faces Using Facial Recognition Cameras

January 1, 2021

Ongoing Purported AI-Assisted Identity Fraud Enables Unauthorized Access to Western Companies by North Korean IT Workers

January 1, 2021

FaceApp Predicted Different Genders for Similar User Photos with Slight Variations

December 24, 2020

Korean Chatbot Luda Reportedly Made Offensive Remarks Towards Minority Groups in South Korea

December 23, 2020

Alibaba Cloud Developed Facial Recognition to Profile Muslim Uyghur Minorities

December 16, 2020

Online Trolls Allegedly Abused TikTok’s Automated Content Reporting System to Discriminate against Marginalized Creators

December 15, 2020

Japanese Porn Depixelated by Man using Deepfake

December 15, 2020

Facebook Mistakenly Blocked Small Business Ads

November 11, 2020

YouTube Recommendation Reportedly Pushed Election Fraud Content to Skeptics Disproportionately

November 1, 2020

AI mistakes referee’s bald head for football — hilarity ensued

October 24, 2020