LLMSurgeon: Diagnosing Data Mixture of Large Language Models.

arXiv:2605.30348v2 Announce Type: replace-cross Abstract: The pretraining data mixture of Large Language Models (LLMs) constitutes their "digital DNA", shaping model behaviors, capabilities, and failure modes. Yet this composition is rarely disclosed, making p