Skip to content
Research

Tsubame: Tree Replay for Diffusion-Based Speculative Decoding.

arXiv:2609.33652v1 Announce Type: cross Abstract: Context-aware dynamic trees allocate the speculative decoding budget according to draft path probabilities, adapting their depth and branching to the current context. Under stochastic decoding, however, we find

arXiv cs.AIResearch source·