Language Models Can Control Their Own Attention.

arXiv:2609.02737v2 Announce Type: replace-cross Abstract: Language models spend most of their attention on a small fraction of context, yet they read the entire KV cache to find the few tokens that matter. If the user asks about a previous detail in a 1M-token