Secure Speculative Decoding for Large Language Models.

arXiv:2610.08678v2 Announce Type: replace-cross Abstract: Speculative decoding accelerates inference for a large language model (LLM), referred to as the \emph{target model}, by first using a smaller model, referred to as the \emph{draft model}, to generate ca