Efficient CPU-GPU collaborative MoE inference via Adaptive Expert Assignment.

arXiv:2610.23006v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models reduce inference computation through sparse expert activation, but their large expert memory footprint often exceeds GPU capacity, making expert offloading necessary for memory-con