MAP 1.6

Control

System requirements (e.g., “the system shall respect the privacy of its users”) are elicited from and understood by relevant AI actors. Design decisions take socio-technical implications into account to address AI risks.

Incidents linked to this control

From automatic embedding match (not a formal assessment).

Google’s Assistive Writing Feature Provided Allegedly Unnecessary and Clumsy Suggestions

April 19, 2022

Honorlock's AI Proctoring System Reportedly Led Broward College to Accuse a Teenager of Cheating

February 15, 2022

Uber Launched Opaque Algorithm That Changes Drivers' Payments in the US

February 10, 2022

Replika's "AI Companions" Reportedly Abused by Its Users

January 15, 2022

Local South Korean Government’s Use of CCTV Footage Analysis via Facial Recognition to Track COVID Cases Raised Concerns about Privacy, Retention, and Potential Misuse

January 1, 2022

Chatbot Encourages Man to Plot Assassination of Queen Elizabeth II

December 25, 2021

Korean Politician Employed Deepfake as Campaign Representative

December 6, 2021

Research Prototype AI, Delphi, Reportedly Gave Racially Biased Answers on Ethics

October 22, 2021

Student-Developed Facial Recognition App Raised Ethical Concerns

October 21, 2021

North Carolina Psychiatrist Used Artificial Intelligence to Produce Images of Child Sex Abuse

August 1, 2021

State Farm Allegedly Discriminated against Black Customers in Claim Payout

June 12, 2021

Kannada Insulted by Google's Featured Answer as "Ugliest Language in India"

June 3, 2021