VASPO: Self-Distillation with Privileged Value Estimation.

arXiv:2610.20516v1 Announce Type: cross Abstract: On-policy self-distillation provides dense supervision for reasoning models via a privileged self-teacher. However, this supervision reflects local token preferences rather than the expected return of an unguid