Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

December 1, 2023

The consequences of these incidents are far-reaching, as they underscore the critical vulnerability of our software supply chains to manipulation by malicious actors. As a result of the widespread distribution of potentially tainted packages, numerous developers have unwittingly integrated malware into their projects, leaving users vulnerable to exploitation. This alarming trend highlights the need for increased vigilance and improved quality control measures in the software development community, with experts urging immediate action to address these concerns. And to stay updated on AI incidents, visit JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Developers using AI-generated suggestions, Bar Lanyado
Alleged developer
OpenAI, Meta, Google, DeepSeek AI, Cohere, BigScience
Alleged harmed parties
Users downstream of software contaminated by hallucinated packages, Trust in open-source repositories and AI-assisted coding tools, Software ecosystems, Organizations that incorporated fake dependencies, Developers and businesses incorporating AI-suggested packages, Alibaba

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/731

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.