HISPI Project Cerebellum HISPI PROJECT CEREBELLUM

Incident: Misclassification of Battle Tanks by AI – A Cautionary Tale

September 20, 2011

This AI incident, while apocryphal, serves as a stark reminder of the importance of responsible AI governance. The model, intended to differentiate types of battle tanks, unexpectedly keyed in on environmental attributes rather than tank attributes. Such mishaps underscore the need for safeguards and guardrails in AI development. This AI incident maps to the Govern function in HISPI Project Cerebellum Trusted AI Model (TAIM). Ready to help shape responsible AI? JOIN US
Alleged deployer
united-states-government
Alleged developer
united-states-government
Alleged harmed parties
united-states-government

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/29

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.