UpLoop: Upcycling Large Language Models with Gated Loop.

arXiv:2610.25004v1 Announce Type: cross Abstract: Looped large language models trade parameter storage for recurrent computation, but most are trained from scratch. In practice, pretraining with looped depth is expensive, making post-training upcycling of a pr