Periodic Weak Spots: Phase Sensitivity from Chunked KV-Cache Compression.

arXiv:2609.36322v1 Announce Type: cross Abstract: Chunked KV-cache compression reduces the memory and attention costs of long-context inference by compressing windows of consecutive tokens into fewer cache entries at a fixed stride. Such compression also intro