Google’s YouTube Kids App Presents Inappropriate Content

May 19, 2015

The recent incident involving Google's YouTube Kids app highlights the importance of robust content filtering measures in protecting vulnerable populations. As a result of inadequate safeguards, children were exposed to disturbing and mature themes, sparking concerns about the long-term impact on their development and well-being. The failure to effectively moderate content underscores the need for greater accountability and transparency in AI-driven platforms, particularly those designed for young users. By prioritizing responsible AI practices and robust moderation strategies, we can help prevent similar incidents and ensure a safer online environment for all. And to learn more about AI incident reporting, visit JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
YouTube
Alleged developer
YouTube
Alleged harmed parties
Minors

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/1

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.