Constrained Decoding: Harmful or Beneficial? Revisiting Its Impact on LLM Performance.

arXiv:2610.35328v1 Announce Type: cross Abstract: Constrained decoding guarantees that Large Language Models (LLMs) produce outputs conforming to predefined formats, but is often assumed to inherently degrade reasoning. We examine this assumption through a tax