ResOPD: Tail Residualization for Sparse On-Policy Distillation.

arXiv:2610.04882v1 Announce Type: cross Abstract: On-policy distillation (OPD) trains a student model on self-generated trajectories, but transmitting dense teacher distributions across long reasoning traces creates prohibitive communication and memory bottlen