Sharpen Without Search: On-Policy Distillation of Sequence-Level Power Distribution.

arXiv:2610.06804v1 Announce Type: cross Abstract: A language model can give a correct answer more probability than any single incorrect answer and still usually sample an incorrect one, because the incorrect answers together hold more probability. The power di