Forget Attention: Importance-Aware Attention Is All You Need.

arXiv:2606.02332v3 Announce Type: replace Abstract: Attention retrieves content precisely, but its scores depend only on query--key products, leaving order and recency to positional encodings. Conversely, state-space models (SSMs) such as Mamba-3 track order a