How Linear Attention Remembers.

arXiv:2609.33093v1 Announce Type: cross Abstract: Linear attention replaces the growing key--value (KV) cache of standard attention with a fixed-size recurrent state, substantially reducing memory growth with context length. This efficiency, however, changes h