Proposing Better Rollouts for On-Policy Distillation.

arXiv:2610.36477v2 Announce Type: replace-cross Abstract: On-policy distillation (OPD) improves language-model post-training by letting the student learn from its own sampled trajectories under teacher supervision, aligning the training process with inference-