DCKV: Learned Transform Coding of the Prompt KV Cache in Hybrid Language Models.

arXiv:2610.36950v1 Announce Type: cross Abstract: Hybrid language models keep a key-value (KV) cache only in their few full-attention layers, but this cache is still the part of a prompt's state that grows with the prompt and that must be stored or moved to re