Misguided AI Design in Amazon Mobile Accessories

Recently, an AI-powered smartphone case designed by Amazon was found to display inappropriate content unexpectedly. The case, which uses a machine learning algorithm to customize the screen based on user interaction, has reportedly shown NSFW images at inconvenient times. This incident serves as a reminder of the importance of responsible AI governance and trustworthy AI models, ensuring they function safely and securely.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

GOVERN 6.1 — similarity 0.492, rank 1. TAIM detail and related incidents →
MAP 1.6 — similarity 0.483, rank 2. TAIM detail and related incidents →
MAP 4.1 — similarity 0.476, rank 3. TAIM detail and related incidents →

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/56

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.