Steering the Teacher: Improving On-Policy Self-Distillation for Thinking Models.

arXiv:2610.34005v1 Announce Type: cross Abstract: On-policy self-distillation (OPSD) trains a student on its own reasoning trajectories using token-level supervision from a reference-conditioned teacher initialized from the same model. However, access to the r