iS-KV: Online Low-Rank KV Cache Compression via Block-Incremental SVD.

arXiv:2610.02815v1 Announce Type: new Abstract: Long chain-of-thought reasoning substantially increases KV-cache memory during autoregressive decoding, as every generated token introduces new key and value states and causes the cache to grow linearly with deco