Linear attention replaces growing KV caches with fixed-size recurrent states, yet these persistent states can become a substantial memory bottleneck under concurrent serving.
← Back to all developments · Signals are a development reported by more than one source. See the methodology.