Knightscope's Park Patrol Robot Ignored Bystander Pressing Emergency Button to Alert Police about Fight

October 4, 2019

An instance occurred in Huntington Park, California where a Knightscope K5 autonomous 'police' robot failed to react when an onlooker activated its emergency alert button during a nearby fight. This underscores the importance of responsible AI governance and trustworthy AI practices.

For those interested in shaping the future of AI incident response and contributing to harm prevention, consider joining Project Cerebellum by visiting JOIN US. This incident also highlights the need for HISPI Project Cerebellum TAIM (Govern) to establish guardrails ensuring safe and secure AI practices.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

MEASURE 2.6 — similarity 0.694, rank 1. TAIM detail and related incidents →
MANAGE 4.3 — similarity 0.653, rank 2. TAIM detail and related incidents →
MANAGE 4.1 — similarity 0.642, rank 3. TAIM detail and related incidents →

Alleged deployer: knightscope
Alleged developer: knightscope
Alleged harmed parties: cogo-guebara, unnamed-woman-injured-in-the-fight

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/77

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.