arXiv:2610.18654v1 Announce Type: cross Abstract: Summary-token architectures such as Kwai Summary Attention (KSA) compress distant context into learnable Summary token per chunk, and hybrid variants interleave these layers with full attention to retain exact
← Back to all developments · Signals are a development reported by more than one source. See the methodology.