Frequency Is Not Sensitivity Identifying Safety-Sensitive Experts in Sparse MoE LLM.
arXiv:2610.02910v1 Announce Type: new Abstract: Suppressing a small set of routed experts can weaken the safety behavior of a sparse Mixture-of-Experts (MoE) language model without retraining. Which experts to suppress is therefore a security question, and the
arXiv cs.AIResearch source·