Do New Attention Mechanisms Actually Fix Attention Sinks at Million-Token Context?

arXiv:2609.08574v2 Announce Type: replace-cross Abstract: Long context language models now advertise windows of one million tokens, but two habits limit how much of that window is used. Attention heads with nothing useful to read still spend their budget on th