Recovering Reliable Supervision via Critique-Guided On-Policy Distillation.

arXiv:2610.20572v1 Announce Type: cross Abstract: On-policy distillation (OPD) trains a student model on its own rollouts with token-level supervision from a teacher, assuming that the teacher can reach a correct answer from any prefix the student writes. We c