BitsMoE: Cost-Aware Bit Allocation in Spectral Space for MoE LLM Quantization.

arXiv:2606.00079v2 Announce Type: replace-cross Abstract: Mixture-of-Experts (MoE) large language models incur substantial memory costs due to their large expert parameter counts. Mixed-precision quantization reduces these costs by allocating different bit-wid