Scaling Multilingual Pretraining of Pixel Language Models.

arXiv:2610.29681v1 Announce Type: cross Abstract: Pixel language models process text as rendered images instead of a finite vocabulary, which gives them strong cross-lingual transfer abilities. However, not much is known about how these abilities are influence