ValueDiff: Value-Geometric KV Cache Eviction for Sink-Suppressed LLMs.

arXiv:2609.23314v2 Announce Type: replace-cross Abstract: Modern LLMs with QK-normalization, gated attention, learned attention sinks, or logit softcapping exhibit weaker persistent attention sinks, on which existing KV cache eviction methods primarily rely. W