STEPQuant: When and Where Errors Matter in Delta-Rule Recurrent State Quantization.

arXiv:2609.38169v1 Announce Type: cross Abstract: Linear attention replaces growing KV caches with fixed-size recurrent states, yet these persistent states can become a substantial memory bottleneck under concurrent serving. Directly quantizing recurrent state