Purported AI Monitoring Software Reportedly Flags Unsent Joke Threat, Leading to Arizona Student Suspension

August 14, 2025

An incident at Marana High School (Arizona) highlights the urgent need for safe and secure AI practices. An AI monitoring software, installed on a school-issued laptop, reportedly flagged an allegedly unsent joke email containing a violent threat typed by a student in his home, in front of his mother. The message was not sent and deemed non-credible by the principal. However, the district's zero-tolerance policy resulted in a 45-day suspension for the student. This case raises concerns about AI governance and the need for trustworthy AI. For those interested in shaping responsible AI practices, JOIN US (HISPI Project Cerebellum TAIM) (Govern) to help establish guardrails for AI incident management.

The family is suing, alleging that the punishment violated the student's rights.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
marana-unified-school-district, marana-high-school
Alleged developer
unknown-ai-monitoring-software-developer
Alleged harmed parties
unnamed-marana-high-school-student's-family, unnamed-marana-high-school-student, students-of-marana-unified-school-district, students-of-marana-high-school

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1177

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.