Alignment Forecasting: Predicting Misalignment From Training Data.
arXiv:2609.35805v2 Announce Type: replace-cross Abstract: Training a language model on data with a narrow flaw can sometimes make the model broadly misaligned. Inspecting the data at face value often does not settle whether it will emerge, and today it is caug
arXiv cs.AIResearch source·