LongSpark: Efficient speculative decoding with a fixed-cost parallel drafter.

arXiv:2609.37029v2 Announce Type: replace-cross Abstract: Speculative decoding accelerates autoregressive inference by verifying multiple draft tokens in a single target forward pass. However, as the context grows, existing state-of-the-art drafters become inc