Shared Low-rank Basis Factorization for Data-free Mixture-of-Experts Compression.

arXiv:2610.09342v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) large language models decouple capacity from compute through sparse routing, but their large parameter count creates storage and serving challenges. We analyze three MoE compression fam