Explaining the Roles of Experts in Mixture-of-Experts LLMs for Personalization.

arXiv:2610.22127v1 Announce Type: cross Abstract: Personalization of Large Language Models (LLMs) is increasingly important for user-centric applications, yet prior methods mainly adapt dense LLMs, whose polysemantic neurons, each encoding multiple unrelated c