Beyond Policy Discrepancy: Capability-Aware Multi-Teacher On-Policy Distillation.

arXiv:2610.26950v2 Announce Type: replace-cross Abstract: Multi-teacher on-policy distillation (MOPD) integrates domain specialists into a shared student, but determining how strongly each teacher should supervise remains challenging. Existing discrepancy-base