Rethinking Self-Distillation for Multi-Teacher Capability Merging.

arXiv:2610.04272v1 Announce Type: cross Abstract: Combining capabilities of multiple expert models trained starting from the same base checkpoint has become increasingly common in frontier language-model post-training. Recent trends suggest that multi-teacher