MaskCoFT: Masked Co-Adaptive Fine-Tuning for Memory-Efficient MoE Inference.

arXiv:2609.34077v2 Announce Type: replace-cross Abstract: Mixture-of-experts (MoE) language models often exceed the memory of a single GPU. Expert offloading keeps most experts in host memory and loads them on demand, so decoding speed depends on how many expe