LoopAhead: Speculating Ahead for Faster Decoding in Looped Language Models.
arXiv:2610.21594v1 Announce Type: new Abstract: Looped Transformers improve parameter efficiency by repeatedly applying the same Transformer layers. However, generating each token still involves sequential computation and repeated access to model weights, lead
arXiv cs.AIResearch source·