When Can First-Order Models of Fine-Tuning Bound Forgetting?

arXiv:2609.32818v1 Announce Type: new Abstract: Fine-tuning a language model on new data can make it forget facts that it should keep. We ask whether measurements taken at the start of a fine-tuning run can bound, for each protected fact, the probability that