Not Every Rollout Needs Distillation: Correctness-Filtered On-Policy Self-Distillation.

arXiv:2610.25842v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) supervises student-generated trajectories with a reference-conditioned version of the same base model. We ask whether every trajectory supplies distinct supervision that warrant