Pretraining

Apple tests lexical substitutions for multilingual transfer Apple Machine Learning Research has described LINK, a data-level method intended to improve multilingual language models when target-language training data is scarce. The approach changes part of the high-resource English pretraining...