arXiv:2610.08678v2 Announce Type: replace-cross Abstract: Speculative decoding accelerates inference for a large language model (LLM), referred to as the \emph{target model}, by first using a smaller model, referred to as the \emph{draft model}, to generate ca
← Back to all developments · Signals are a development reported by more than one source. See the methodology.