AS$^2$D: Accelerating On-Demand Audio Understanding on Mobile Devices.

arXiv:2609.37617v1 Announce Type: cross Abstract: Speculative decoding accelerates autoregressive generation by using a smaller drafter to propose tokens for batched verification by a larger target. However, conventional speculative decoding couples drafting t