header-langage
简体中文
繁體中文
English
Tiếng Việt
한국어
日本語
ภาษาไทย
Türkçe
Scan to Download the APP

Providing tens of millions of incorrect answers per hour, based on Gemini 3, Google Search's "AI Overview" has an accuracy rate of only 91%.

BlockBeats News, May 5th, according to The New York Times, AI startup Oumi's analysis of Google's "AI Summary" feature shows that the feature's accuracy rate is approximately 90%. Since Google processes over 50 trillion searches per year, this means it provides tens of millions of wrong answers every hour (or hundreds of thousands of inaccuracies per minute).


Oumi used the SimpleQA benchmark to analyze Google's "AI Summary" search results and found that when using Gemini 2, 85% of the results were accurate; with Gemini 3, this proportion rose to 91%.


During the analysis of the 5380 sources referenced by Google's AI Summary, Oumi found that Facebook and Reddit were the second and fourth most cited sources, respectively. When Google's AI Summary is accurate, 5% of the citations reference Facebook; when inaccurate, 7% reference Facebook.

举报 Correction/Report
Correction/Report
Submit
Add Library
Visible to myself only
Public
Save
Choose Library
Add Library
Cancel
Finish