ConMoE: MoE Compression as Expert Selection and Functional Assignment.
arXiv:2605.29350v2 Announce Type: replace Abstract: Sparse Mixture-of-Experts (MoE) models scale model capacity through sparse activation, but storing their full parameters remains costly in GPU memory. Existing expert compression methods address this problem
arXiv cs.AIResearch source·