Interpolated Policy Distillation: A Controllable Continuum Between Off-Policy and On-Policy Distillation.

arXiv:2609.37170v1 Announce Type: cross Abstract: Off-policy and on-policy distillation have traditionally been formulated as separate paradigms, each favoring a different property of distillation trajectories. Teacher-generated (off-policy) traces are typical