Token Utility for On-Policy Distillation via Local Trust-Region Optimization.

arXiv:2610.18883v1 Announce Type: cross Abstract: Token-selection methods for on-policy distillation (OPD) prioritize student-visited positions using diverse signals, including uncertainty, teacher-student disagreement, and mismatch direction. We instead deriv