LayerRoPE: Dynamic Depth-wise Magnitude & Angular Superposition.

arXiv:2610.09179v1 Announce Type: cross Abstract: As data propagates through a Transformer, the norm of its hidden states grows by orders of magnitude with depth, a phenomenon framed as 'curse of depth' and nearly universally treated as a pathology to be suppr