Adaptive Pullback: Reweighting Supervision at Penalty Jumps in On-Policy Distillation.

arXiv:2610.28194v1 Announce Type: cross Abstract: On-policy distillation (OPD) supervises student-generated responses using sampled-token student-teacher log-ratios. A positive log-ratio penalizes a token that the student assigns higher probability to than the