Verify Before You Distill: Prompt-Level Teacher Gating for On-Policy Distillation.

arXiv:2609.02998v2 Announce Type: replace-cross Abstract: On-policy distillation (OPD) accelerates post-training by providing dense token-level supervision from a frozen teacher on the student's own rollouts. Vanilla OPD applies this supervision uniformly acro