Where Draft Trees Lose Target Mass: Exit-Guided Speculative Decoding.
arXiv:2610.11750v1 Announce Type: new Abstract: Tree-based speculative decoding verifies multiple draft continuations in one target-model pass, but finite trees built from draft scores face a fundamental draft-target mismatch. We ask whether better exact verif
arXiv cs.AIResearch source·