Monte Carlo Estimation for KV Cache Eviction.

arXiv:2610.07643v2 Announce Type: replace-cross Abstract: Most KV-cache eviction methods ask, in effect, which memory appeared important while reading the prompt? We instead ask which memory will matter while answering? Since decoding queries are unavailable a