T2D: Target-to-Draft Model Pruning & Adaptation for Efficient Speculative Decoding.
arXiv:2610.34103v1 Announce Type: cross Abstract: Speculative decoding significantly accelerates autoregressive text generation in Large Language Models (LLMs), but its efficacy depends largely on two key factors: the distributional alignment between the draft
arXiv cs.AIResearch source·