Think you can trust ChatGPT and Gemini to bring you the news? Here’s why you might want to think again


  • Almost half of all AI assistant responses about the news contain major errors, a major international study has found
  • The factual, procurement or contextual issues were evident across 14 languages ​​and 18 countries
  • Gemini fared worst with twice as many significant problems compared to the competition

When you ask an AI assistant about news and current events, you can expect a detached, authoritative answer. But according to a wide-ranging international study led by the BBC and coordinated by the European Broadcasting Union (EBU), almost half of the time these answers are wrong, misleading or simply made up (anyone who has dealt with the nonsense of Apple’s AI-written headlines can relate).

The report dug into how ChatGPT, Microsoft Copilot, Google Gemini and Perplexity handle news queries across 14 languages ​​in 18 countries. The report analyzed over 3,000 individual responses from the AI ​​tools. Professional journalists from 22 public media outlets rated each answer for accuracy, buyability and how well it distinguished news from opinion.

The results were grim for those who relied on AI for their news. The report found that 45% of all responses had a significant problem, 31% had procurement issues and 20% were simply inaccurate. This isn’t just a matter of one or two embarrassing mistakes, like mistaking Belgium’s prime minister for the frontman of a Belgian pop group. The research found deep, structural problems with how these assistants process and deliver news, regardless of language, country or platform.

(Image credit: BBC/EBU)

In some languages, the assistants directly hallucinated details. In others, they attributed citations to outlets that had not published anything even close to what was being cited. Context was often lacking, with the assistants sometimes providing simplified or misleading overviews instead of decisive nuances. In the worst cases, it can change the meaning of an entire news story.

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top