BRANCH-MoE: Balance-Aware Tree Routing for Large Embedding Models.

arXiv:2610.06725v1 Announce Type: cross Abstract: Mixture-of-experts (MoE) layers increase model capacity without a proportional increase in per-example computation. However, conventional flat routers can yield imbalanced expert utilization and treat experts a