Gains and Collapse in On-Policy Distillation:A Reinforcement Learning Perspective.

arXiv:2610.03185v1 Announce Type: new Abstract: On-policy distillation (OPD) has become an important approach to language model post-training. However, despite its performance gains, OPD can also collapse into excessively long and repetitive generation, and th