Does On-Policy Distillation Need to Complete Every Rollout?

arXiv:2610.21337v3 Announce Type: replace-cross Abstract: On-policy distillation (OPD) transfers teacher knowledge to a student through feedback on student-generated rollouts, but generating complete rollouts and computing per-token teacher feedback are comput