California Bar Exam: Unusual Cheating Allegations Highlight Need for Responsible AI in Proctoring

December 4, 2020

The proctoring algorithm used in a California bar exam flagged an unusually high number of alleged cheaters, affecting around a third of thousands of applicants. Controversy ensued when examinees were instructed to prove their innocence without being allowed to view incriminating video evidence. This AI incident maps to the Govern function in HISPI Project Cerebellum Trusted AI Model (TAIM).JOIN US A responsible AI solution could have prevented such harm and preserved trust in the exam process.
Alleged deployer
california-bar's-committee-of-bar-examiners
Alleged developer
examsoft
Alleged harmed parties
california-bar-exam-takers, flagged-california-bar-exam-takers

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/131

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.