AttSVD:Prompt-Adaptive Low-Rank KV Cache Compression via Attention-Guided SVD.

arXiv:2610.06927v1 Announce Type: cross Abstract: The key-value (KV) cache of autoregressive transformers grows linearly with context length and dominates memory at long context. Most training-free remedies evict low-importance tokens, an irreversible choice a