Train Ahead, Distill Back: Bootstrapping On-Policy Self-Distillation for Large Language Models.

arXiv:2609.37132v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) improves large language models by letting a self-teacher with privileged information provide dense token-level supervision on the model's own trajectories. Yet existing methods