When to Follow the Teacher: Advantage-Based On-Policy Distillation.

arXiv:2610.31563v1 Announce Type: cross Abstract: Online Policy Distillation (OPD) often outperforms offline methods such as Supervised Fine-Tuning (SFT) by training on trajectories sampled directly from the student. However, standard OPD trains the student to