Softmax Reparameterization for Output-Head Quantization.

arXiv:2609.31291v2 Announce Type: replace-cross Abstract: Large vocabularies make output heads a substantial inference cost in small language models. We introduce softmax reparameterization, a post-training method that searches over functionally equivalent out