D$^3$-MOPD: Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation.

arXiv:2608.24987v2 Announce Type: replace-cross Abstract: Multi-teacher on-policy distillation (MOPD) distills several domain-expert teachers into a single student by minimizing per-domain reverse-KL divergence on the student's own rollouts. Existing approache