Skip to content
Research

T2D: Target-to-Draft Model Pruning & Adaptation for Efficient Speculative Decoding.

arXiv:2610.34103v1 Announce Type: cross Abstract: Speculative decoding significantly accelerates autoregressive text generation in Large Language Models (LLMs), but its efficacy depends largely on two key factors: the distributional alignment between the draft

arXiv cs.AIResearch source·