Cross-Lingual Alignment for Decoder-Only Models using MoE Routers.

arXiv:2610.01921v2 Announce Type: replace-cross Abstract: Cross-lingual contrastive learning has been a core component of multilingual encoder training, but the ability to explicitly align representations is not possible in decoder-only LLMs because of varying