Scaling to Tens of Thousands of Test-Time Iterations with Loop-Native Attention Residuals.

arXiv:2610.11570v2 Announce Type: replace Abstract: In this paper, we argue that Looped Transformers need their own residual connections to prevent performance degradation as the number of iterations grows. We first introduce an interesting phenomenon we obser