Gaggle AI Monitoring at Lawrence, Kansas High School Reportedly Misflags Student Content and Blocks Emails

August 1, 2025

In Lawrence, Kansas, students have accused the Gaggle Safety Management AI of incorrectly flagging benign schoolwork, such as art photos and casual messages, as child pornography or threats. The system is reported to have deleted content, blocked an email records request, and led to interrogations of students. Critics argue this constitutes a chilling effect on free speech and poses privacy risks. A lawsuit filed in August 2025 contests the district's use of Gaggle as unconstitutional surveillance. Gaggle denies any compromises to user privacy.

Join the HISPI Project Cerebellum community to help shape responsible AI governance and prevent such incidents. By mapping this misuse case to the HISPI Project Cerebellum TAIM (Measure function), we can work towards ensuring safe and secure AI practices for educational institutions.
JOIN US

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
lawrence-public-schools-(usd-497)
Alleged developer
gaggle
Alleged harmed parties
lawrence-public-schools-(usd-497)-students

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1213

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.