BitNest: Bit-Nested Speculative Decoding for Memory-Efficient LLM Inference Acceleration.

arXiv:2610.02800v2 Announce Type: replace Abstract: Speculative decoding accelerates autoregressive generation by using a lightweight draft to propose multiple tokens for parallel verification. However, existing methods often require an additional draft model