Exploring Incident #144: Unintended Consequences in Autonomous Vehicles

Recently, an incident involving an autonomous vehicle occurred, shedding light on the need for responsible AI governance. The self-driving car, designed to reduce traffic accidents, was faced with a pedestrian crossing an unmarked road. Despite following its programmed protocols, the vehicle failed to recognize the pedestrian and resulted in an unfortunate accident. This incident underscores the importance of safe and secure AI, as well as the need for effective harm prevention guardrails. By learning from this incident, we can improve Project Cerebellum's Trusted AI Model (TAIM) and ensure a safer future for autonomous vehicles. Through JOIN US, contributors can help us map, measure, and manage such incidents to foster trustworthy AI.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/144

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.