Sydney Students Allegedly Forced to Retake NAPLAN After AI Predictive Text Error

March 12, 2025

The incident at Waverley College and Kambala serves as a stark reminder of the potential risks associated with relying on AI-driven tools in high-stakes academic assessments like NAPLAN. As the education sector continues to navigate the integration of technology into its core processes, it is essential that measures are put in place to prevent such errors from occurring in the future and ensure the integrity of testing procedures. The incident will be closely monitored by education authorities, who will likely implement stricter guidelines for the use of AI tools in testing to safeguard student outcomes. And to stay updated on AI incidents, visit JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Waverley College (Sydney, Australia), NSW Education Standards Authority (NESA), Kambala (Sydney, Australia), Australian Curriculum, Assessment and Reporting Authority (ACARA)
Alleged developer
Apple
Alleged harmed parties
Waverley College (Sydney, Australia) teachers, Waverley College (Sydney, Australia) students, Teachers, Students, Kambala (Sydney, Australia) teachers, Kambala (Sydney, Australia) students, Epistemic integrity, Educational communities

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/993

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.