How to Use Parallel Data for Multilingual Pretraining.

arXiv:2610.28838v1 Announce Type: cross Abstract: High-quality human-translated parallel corpora can improve cross-lingual transfer, but are typically too small for large-scale pretraining. Machine-translated web corpora help overcome this limitation, making p