Proctoring Algorithm in Online California Bar Exam Flagged an Unusually High Number of Alleged Cheaters

December 4, 2020

California bar exam proctoring algorithm flagged an unusual number of cheaters, allegedly three thousand applicants. Examinees were instructed to prove their innocence without viewing the incriminating video evidence. This incident emphasizes the need for safe and secure AI practices, particularly in governance and guardrails for AI systems.

For those interested in shaping responsible AI governance and improving harm prevention measures, consider joining HISPI Project Cerebellum TAIM to Measure the impact of such incidents on trustworthy AI.

JOIN US

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

MEASURE 2.6 — similarity 0.671, rank 1. TAIM detail and related incidents →
MEASURE 2.10 — similarity 0.655, rank 2. TAIM detail and related incidents →
MEASURE 1.3 — similarity 0.653, rank 3. TAIM detail and related incidents →

Alleged deployer: california-bar's-committee-of-bar-examiners
Alleged developer: examsoft
Alleged harmed parties: california-bar-exam-takers, flagged-california-bar-exam-takers

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/131

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.