One Distribution, Two Channels: Coverage-Calibrated KV Retention and Compensation.
arXiv:2610.02235v2 Announce Type: replace-cross Abstract: Long-context decoding is increasingly constrained by key--value (KV) cache memory and bandwidth. Existing fixed-budget compression methods typically separate retention from compensation, while a retenti
arXiv cs.AIResearch source·