ARC-KV: Amortizing Anchor Search for Reconstruction-Based KV Cache Compaction.

arXiv:2609.36835v1 Announce Type: new Abstract: Long-context large language model inference is bottlenecked by KV caches that grow linearly with sequence length. This burden is especially severe for long, reusable context prefixes, whose cache must serve many