Alignment via Training Against Probes Without Losing Monitorability.

arXiv:2609.38645v3 Announce Type: replace-cross Abstract: Models are usually aligned based on their observed outputs, using demonstrations, preference data, or reward signals. These objectives reward responses that look aligned. More capable models may learn t