Correcting or Continuing? What On-Policy Distillation Learns from Student Errors.

arXiv:2610.18011v1 Announce Type: cross Abstract: On-policy distillation (OPD) trains a student on its own rollouts under a frozen teacher, mitigating the distribution mismatch of off-policy supervision. While prior work has primarily trained on problems a stu