Divergence-Routed On-Policy Distillation for Language Models.

arXiv:2610.19572v1 Announce Type: new Abstract: On-policy distillation (OPD) transfers knowledge from a teacher model to a student along student-generated trajectories, typically by minimizing the reverse Kullback-Leibler (RKL) divergence. However, RKL can pro