DScale: Scaling Block-Diffusion Speculative Decoding with Adaptive Verification.
arXiv:2609.37532v1 Announce Type: cross Abstract: Growing large language model applications demand efficient inference. At high concurrency, block-diffusion speculative decoding suffers from verification padding, rejected candidates, and incompatibility betwee
arXiv cs.AIResearch source·