Alleged Gaggle Surveillance Alert Reportedly Leads to Arrest and Detention of 13-Year-Old Student in Fairview, Tennessee

August 15, 2023

Sometime in August 2023, a 13-year-old student at Fairview Middle School in Tennessee was reportedly arrested, strip-searched, and detained overnight after Gaggle's purported AI-powered surveillance system flagged a private online message as a threat. The student's comment, reportedly a joke in context, was sent to law enforcement under a state zero-tolerance law. The incident reportedly resulted in house arrest, alternative school placement, and a lawsuit alleging wrongful arrest.

This alarming incident raises questions about the use of AI-powered surveillance systems in schools and the consequences for students who may be misidentified as threats.

The incident serves as a stark reminder that our increasingly automated justice systems can have devastating effects on young lives. The fact that a single student's careless comment was misinterpreted and escalated into a full-blown arrest has left the Fairview community reeling, and it is imperative that we take steps to ensure this does not happen again. We urge lawmakers and school administrators to take immediate action to review and revise zero-tolerance policies and AI-powered surveillance systems to protect students' rights and prevent future incidents from occurring. And to stay informed about AI incidents, visit JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Williamson County Schools, Fairview Middle School, Tennessee
Alleged developer
Gaggle
Alleged harmed parties
Unnamed 13-year-old student from Fairview, Tennessee, Students, Privacy, Minors, Educational communities, Biometric data subjects

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1167

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.