Adaptive DHiSparse: Speculative Decoding over a Load-Adaptive KV Hierarchy

arXiv:2610.13708v1 Announce Type: new Abstract: Long-context serving runs out of KV memory before the hardware reaches its useful throughput.

← Back to all developments · Signals are a development reported by more than one source. See the methodology.