Beyond the Training Horizon: Mechanisms and Limits of Length Generalization in Looped Transformers.

arXiv:2609.33144v1 Announce Type: cross Abstract: Looped Transformers can generalize to reasoning chains longer than those encountered during training, but the computations enabling this behavior and limiting its extent remain unclear. We mechanistically compa