Stabilizing Extrapolation in Looped Transformers via Learned Stochastic Stopping.

arXiv:2606.29983v2 Announce Type: replace-cross Abstract: Looped Transformers, which repeatedly apply a shared transformer block, are an architecturally natural fit for variable-length algorithmic tasks. Although they can exhibit strong length generalization b