“Amazon’s Choice” Algorithm Failed to Recommend Functional Products and Prone to Review Manipulation

December 15, 2016

Amazon’s “Amazon’s Choice” algorithm recommended poor-quality defective products and were reportedly susceptible to manipulation by inauthentic reviews.

This issue raises concerns about the reliability of AI-driven recommendation systems in e-commerce, highlighting the need for responsible AI governance and harm prevention measures. The incident also underscores the importance of ensuring trustworthy AI practices, including rigorous testing and validation protocols.

To address these concerns, it is essential to implement guardrails for AI that promote safe and secure AI use cases. This can be achieved through the adoption of HISPI Project Cerebellum TAIM, which provides a framework for trusted AI model development and deployment.

JOIN US to learn more about implementing effective AI governance strategies and preventing AI-related harm.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Amazon
Alleged developer
Amazon
Alleged harmed parties
Amazon users

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/330

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.