OpenAttention: One Percent Is Enough with Tail Proxies.

arXiv:2610.30951v3 Announce Type: replace-cross Abstract: Sparse attention reads only a small subset of the key-value cache, and how to treat the unread tail remains a key challenge. Discarding the tail biases the output, and sampling it as previous approaches