SlimWise: Decoupling Expert Pruning Across Prefill and Decode for Efficient MoE Serving.

arXiv:2609.34117v1 Announce Type: cross Abstract: Mixture-of-experts (MoE) models activate few experts per token, yet batched decoding can access nearly the entire expert pool, making expert-weight traffic a major bottleneck. Expert pruning reduces this traffi