Tsubame: Tree Replay for Diffusion-Based Speculative Decoding.
arXiv:2609.33652v1 Announce Type: cross Abstract: Context-aware dynamic trees allocate the speculative decoding budget according to draft path probabilities, adapting their depth and branching to the current context. Under stochastic decoding, however, we find
arXiv cs.AIResearch source·