FreeSolo: Linear-time Sparse Attention with Zero-Shot Length Extrapolation.

arXiv:2610.17191v1 Announce Type: cross Abstract: Linear-time sequence models typically store long-context information in a recurrent state. A fixed-size state limits how much information can be stored, while hybrid architectures that add full attention for be