A Solvable Theory of Pre-training Data Poisoning: Regime-Dependent Scaling Exponents.

arXiv:2609.32288v1 Announce Type: cross Abstract: Pre-training data poisoning of large language models is usually studied using targeted backdoors and their survival through safety post-training, which leaves open a more basic question: how does a model's clea