HISPI Project Cerebellum
AI Incidents

Chatbot in Workplace Training at Bunbury Prison Reveals Real Names in Sexual Harassment Case

August 20, 2024

During workplace training at Bunbury Prison in Western Australia, a trainer used Microsoft's Copilot AI chatbot to generate case study scenarios. The chatbot produced a scenario that included the real name of a former employee involved in a sexual harassment case, revealing sensitive information.
Alleged deployer
charlotte-ingham, western-australia-department-of-justice
Alleged developer
microsoft
Alleged harmed parties
bronwyn-hendry, western-australia-department-of-justice, western-australia-department-of-justice-senior-staff-members

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/773

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.