Teacher Should Think Ahead: Adaptive Continuations for Reliable On-Policy Distillation.

arXiv:2609.22254v1 Announce Type: cross Abstract: On-policy distillation (OPD) is a promising approach for transferring knowledge between language models, where a student receives dense token-level supervision along its own generated trajectories. However, tea