Accelerating Constrained Decoding with Token Space Compression.

arXiv:2605.29986v2 Announce Type: replace Abstract: To guarantee that an LLM's outputs conform to a specified structure, context-free grammar (CFG) decoding engines force the selection of next tokens to produce strings that conform to a given CFG. Current CFG-