Breaking the Space Barrier and its Application to Language Model Inference.

arXiv:2610.09139v1 Announce Type: new Abstract: Language models are more and more often asked for structured output: JSON that follows a schema, or a tool call with typed arguments. A small machine, an automaton, enforces the format by forbidding the tokens th