KV$^2$: A Self-Refining KV Cache.

arXiv:2610.03198v2 Announce Type: replace Abstract: The memory footprint of the key-value (KV) cache constrains the practical use of long-context models, and it dominates cost when one prefilled context must later serve many different queries. In this reusable