Next Token or Vector? Learning How Far to Decode.

arXiv:2610.22788v1 Announce Type: cross Abstract: Standard autoregressive decoding advances one token at a time, even when several upcoming tokens can be predicted together. We propose CADENCE (Context-Adaptive DEcoding), a generation method that learns both w