Architecture-Aware Reinforcement Learning Makes Sliding-Window Attention Competitive in Math Reasoning.

arXiv:2606.11634v2 Announce Type: replace Abstract: The rapid progress of reasoning and agentic large language models (LLMs) has increased the demand for long-context inference, but self-attention (SA) scales quadratically with context length. To address this,