National Company Law Tribunal Reportedly Relied on AI-Hallucinated Precedents in Pooja Ramesh Singh v. Jammu and Kashmir Bank Ltd

In Pooja Ramesh Singh v. Jammu and Kashmir Bank Ltd., India's National Company Law Tribunal (NCLT) reportedly admitted insolvency proceedings against Essel Infraprojects after relying on six purported precedents later found to be fabricated or materially inaccurate. The appellate tribunal upheld the ruling, but the Supreme Court later invalidated both decisions and sent the insolvency petition back to the NCLT for a new ruling.

This incident highlights the risks of relying on flawed AI-generated legal precedents, emphasizing the need for rigorous quality control measures in AI-driven decision-making processes. As the use of artificial intelligence in law enforcement continues to expand, it is crucial that we prioritize the accuracy and reliability of AI-generated results. By doing so, we can ensure that justice is served and harm is prevented.

The incident raises important questions about the governance and oversight of AI systems in legal contexts. It underscores the importance of developing robust guardrails for AI use in law enforcement, including standards for data quality, algorithmic transparency, and human oversight. By learning from this incident and implementing these measures, we can work towards a safer and more trustworthy AI ecosystem.

…through JOIN US.