Dynamic Expert Pruning for Multi-Agent Systems.
arXiv:2610.02951v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) architectures scale language models efficiently by activating only a few experts per token, but the saving is confined to computation: every expert must stay resident on the accelerator
arXiv cs.AIResearch source·