Compression Precedes, Content Decides: Emergent Misalignment in Reward Models.

arXiv:2610.22805v1 Announce Type: new Abstract: Emergent Misalignment - the out of domain generalization of narrow harmful fine-tuning first shown by Betley et al. [2025] has been widely studied in language models but not in reward models that supervise them.