Skip to content
Research

DRelay: Global Draft Context for Prefix-Aware Parallel Speculative Decoding Repair.

arXiv:2610.01439v1 Announce Type: new Abstract: Parallel drafting reduces the drafting overhead of speculative decoding for large language models (LLMs), but its gains remain limited by the accepted prefix length. Even when the correct token is present in the

arXiv cs.AIResearch source·