HISPI Project Cerebellum HISPI PROJECT CEREBELLUM

Sydney Students Allegedly Forced to Retake NAPLAN After AI Predictive Text Error

March 12, 2025

An allegedly compromised predictive text feature due to a technical oversight on the NAPLAN writing exam in Waverley College and Kambala, Sydney, led to affected students being forced to retake the test. The incident highlights the importance of safe and secure AI practices in high-stakes assessments like NAPLAN, which underscores the need for robust governance and responsible AI management in such contexts. This event can be mapped to the 'Govern' function of HISPI Project Cerebellum TAIM. For those interested in shaping trustworthy AI practices, JOIN US.

This incident illustrates how AI malfunctions can impact test integrity and fairness, emphasizing the need for strong AI governance mechanisms to ensure safe and secure testing environments. Join Project Cerebellum today to contribute to the AI incident database and help prevent harm in AI applications.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
nsw-education-standards-authority-(nesa), australian-curriculum-assessment-and-reporting-authority-(acara), waverley-college-(sydney-australia), kambala-(sydney-australia)
Alleged developer
apple
Alleged harmed parties
waverley-college-(sydney-australia)-students, waverley-college-(sydney-australia)-teachers, kambala-(sydney-australia)-students, kambala-(sydney-australia)-teachers

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/993

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.