Not Every Token Is Worth Distilling: Selective Supervision for Direct-OPD.

arXiv:2609.29142v2 Announce Type: replace-cross Abstract: Direct On-Policy Distillation (Direct-OPD) transfers reinforcement-learning-induced policy improvements from a small model to a larger student by using the token-level log-ratio between post-RL and pre-