Continuum Attention.
arXiv:2610.20586v2 Announce Type: replace-cross Abstract: Conventional causal attention aggregates values at discrete memory positions. We introduce Continuum Attention (CA), in which neighboring key and value vectors define a continuous, piecewise linear memo
arXiv cs.AIResearch source·