Spend Teacher Tokens Where They Matter: Success-Referenced On-Policy Distillation.

arXiv:2610.02678v1 Announce Type: new Abstract: On-policy distillation (OPD) combines student-generated rollouts with dense token-level supervision from a teacher, but providing such supervision for every rollout requires substantial teacher computation. We in