Does self-distillation improve reasoning?

arXiv:2610.18613v1 Announce Type: cross Abstract: Self-distillation is an emerging approach that trains a model to imitate its own predictions when conditioned on privileged information, such as correct answers or environmental feedback. Recent methods have re