Shaping Latent Mixture-of-Experts: From Expert Geometry to Layerwise Capacity Allocation.

arXiv:2610.14644v1 Announce Type: new Abstract: Fine-grained mixture-of-experts (MoE) models commonly increase expert count by narrowing each expert, treating expert shape as a by-product of routing granularity. LatentMoE moves expert computation into a lower-