TeachBack: Learning to Teach via Bidirectional Preference Optimization for On-Policy Self-Distillation.

arXiv:2610.29167v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) enables a language model to learn from a Teacher instantiated from the same model but given access to privileged information, such as a reference solution. We find that access t