ChatGPT Reportedly Introduces Errors in Critical Child Protection Court Report
September 25, 2024
A child protection worker in Victoria, Australia reportedly used ChatGPT to draft a report submitted to the Children's Court. The purportedly AI-generated report contained inaccuracies and downplayed risks to the child, allegedly resulting in a privacy breach when sensitive information was shared with OpenAI.
- Alleged deployer
- government-of-victoria, employee-of-department-of-families-fairness-and-housing, department-of-families-fairness-and-housing
- Alleged developer
- openai
- Alleged harmed parties
- unnamed-family-of-child, unnamed-child
Source
Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/807
Data source
Incident data is from the AI Incident Database (AIID).
When citing the database as a whole, please use:
McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.
Pre-print on arXiv · Database snapshots & citation guide
We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.