Trajectory-Retrieval Speculative Decoding: When Does a Model's Own History Help?

arXiv:2610.07350v1 Announce Type: new Abstract: Long chain-of-thought reasoning increases sequential decoding cost while creating a growing history of potentially reusable continuations. We investigate when this history supplies useful drafts and complements a