Tesla on Autopilot Crashed Parked Michigan Police Car on Interstate

March 17, 2021

A Tesla Model Y on Autopilot collided with a parked Michigan State Police (MSP) car which had its emergency lights on, in Eaton County, Michigan. The incident occurred when the vehicle failed to stop for a stationary object, despite having the Autopilot feature enabled. As a result of the incident, the police department is now urging drivers to exercise caution and maintain control over their vehicles at all times while using semi-autonomous features like Autopilot.

The incident serves as a reminder of the importance of responsible AI development and deployment. It highlights the need for robust testing and validation procedures to ensure that autonomous systems can handle unexpected situations without compromising safety. Furthermore, it underscores the significance of implementing guardrails for AI in critical environments, such as public roads.

The devastating consequences of this accident will undoubtedly lead to improvements in Autopilot's detection capabilities, while also prompting a broader conversation about the role of AI in public safety. As we move forward with the development and deployment of autonomous technologies, it is crucial that manufacturers and regulators prioritize rigorous testing and validation procedures to prevent similar incidents from occurring. The incident documented in our AI incident database serves as a stark reminder of the importance of responsible AI innovation, and we invite you to join us in shaping a safer future for all road users. And to learn more about AI incident reporting, visit JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Tesla
Alleged developer
Tesla
Alleged harmed parties
unnamed 22-year-old male driver, Tesla drivers

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/333

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.