MOPD-Router: Rethinking Teacher Routing in Multi-Teacher On-Policy Distillation.

arXiv:2609.30837v2 Announce Type: replace-cross Abstract: Multi-teacher on-policy distillation (MOPD) integrates specialized capabilities into a single student, but existing practice typically hard-routes each prompt to a domain-matched teacher for the entire