What Happens to the Goal? Distinct Failures of Policy Alignment in Goal Misgeneralization.

arXiv:2610.19731v2 Announce Type: replace-cross Abstract: Goal misgeneralization is a common failure mode in which an agent behaves competently out of distribution but pursues a proxy that coincided with the intended goal during training instead of the goal it