Train4Merge: RL or SFT---Which Yields Better Teachers for OPD-Based Model Merging?

arXiv:2609.32303v3 Announce Type: replace Abstract: Domain experts trained from a shared checkpoint can transfer their specialized capabilities to a single student through on-policy distillation (OPD). Existing research primarily focuses on improving this merg