Bing Chat's Outputs Featured in Demo Video Allegedly Contained False Information

February 8, 2023

Microsoft's demo video of Bing Chat reportedly featured false or made up information such as non-existent pet vacuums features or false figures on financial statements.

This is a critical issue that raises concerns about the reliability and trustworthiness of AI systems. It highlights the need for robust testing, validation, and governance of AI models to ensure they produce accurate and trustworthy outputs. As part of our efforts to promote responsible AI practices, we are working closely with Microsoft to investigate this incident and learn from it.

As the investigation into Bing Chat's demo video continues, experts emphasize the importance of verifying claims made by AI systems and holding developers accountable for the accuracy of their outputs. The incident underscores the need for stricter testing protocols and rigorous validation procedures to ensure that AI models deliver trustworthy results. The public deserves transparency about AI capabilities, and it is crucial that companies like Microsoft take proactive steps to address such concerns and maintain trust in their products, by visiting JOIN US.

Matched TAIM controls

Suggested mapping from embedding similarity (not a formal assessment). Browse all TAIM controls

Alleged deployer
Microsoft
Alleged developer
OpenAI, Microsoft
Alleged harmed parties
Microsoft

AI governance case studies

For forensic AI governance failure analysis (TAIMScore™ case studies), browse Human Signal’s Failure Files™.

Source

Data from the AI Incident Database (AIID). Cite this incident: https://incidentdatabase.ai/cite/504

Data source

Incident data is from the AI Incident Database (AIID).

When citing the database as a whole, please use:

McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. In Proceedings of the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). Virtual Conference.

Pre-print on arXiv · Database snapshots & citation guide

We use weekly snapshots of the AIID for stable reference. For the official suggested citation of a specific incident, use the “Cite this incident” link on each incident page.