Kwai Summary Attention V2 Technical Report.

arXiv:2610.18654v2 Announce Type: replace-cross Abstract: Summary-token architectures such as Kwai Summary Attention (KSA) compress distant context into learnable Summary token per chunk, and hybrid variants interleave these layers with full attention to retai