Defence against the dark arts of distillation: Unsupervised discovery of subliminal learning.

arXiv:2610.13536v1 Announce Type: cross Abstract: When a language model is distilled from a teacher that shares its base parameters, the student can inherit behavioural traits of the teacher---including misalignment---even from data that is semantically unrela