DAMP: Decay-Aware Mixed-Precision Recurrent-State Quantization.
arXiv:2608.27513v2 Announce Type: replace-cross Abstract: Complex reasoning and agentic applications increasingly rely on long-context inference, where growing KV caches increase both memory usage and decoding overhead. Hybrid models reduce these costs by comb
arXiv cs.AIResearch source·