MAP 1.6

Objective

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

Kannada Insulted by Google's Featured Answer as "Ugliest Language in India"

June 3, 2021

Tesla Allegedly Misled Customers about Autopilot and FSD Capabilities

May 28, 2021

Facebook, Instagram, and Twitter Cited Errors in Automated Systems as Cause for Blocking pro-Palestinian Content on Israeli-Palestinian Conflict

May 23, 2021

Replika's AI Partners Reportedly Sexually Harassed Users

May 18, 2021

Black Uber Eats Driver Allegedly Subjected to Excessive Photo Checks and Dismissed via FRT Results

April 1, 2021

Players Manipulated GPT-3-Powered Game to Generate Sexually Explicit Material Involving Children

April 1, 2021

Amazon Forced Deployment of AI-Powered Cameras on Delivery Drivers

March 2, 2021

Facebook's Automated Tools Failed to Adequately Remove Hate Speech, Violence, and Incitement

March 1, 2021

California's Algorithm Considered ZIP Codes in Vaccine Distribution, Allegedly Excluding Low-Income Neighborhoods and Communities of Color

February 12, 2021

Facebook’s Advertisement Moderation System Routinely Misidentified Adaptive Fashion Products as Medical Equipment and Blocked Their Sellers

February 11, 2021

California Police Turned on Music to Allegedly Trigger Instagram’s DCMA to Avoid Being Live-Streamed

February 5, 2021

AI-Generated Deepfakes Reportedly Derailed Political Career of Florida Official

February 5, 2021