EAT: Expert Account Tracker for Efficient MoE Inference.

arXiv:2609.33614v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models have emerged as a revolutionary method to scale Transformer models. However, traditional MoE architecture still suffers from inefficiency since a large number of experts are unnece