Routing Drift Alone Does Not Diagnose Failure in Merged MoE LLMs.
arXiv:2609.32821v1 Announce Type: new Abstract: Model merging efficiently combines specialized large language models (LLMs) without joint retraining, but can substantially alter expert routing in Mixture-of-Experts (MoE) models. Such \emph{routing drift} is of
arXiv cs.AIResearch source·