Where Position Matters: Profiling-Guided Layer-Wise RoPE Allocation in Transformers.

arXiv:2610.39223v1 Announce Type: cross Abstract: Rotary Position Embedding (RoPE) typically uses uniform coverage across Transformer layers despite heterogeneous positional requirements. Phase-off interventions reveal non-uniform, model-specific rotary-phase