Selective Transfer through Sequence Distillation: From Benchmark Knowledge to Backdoor Behaviour.

arXiv:2610.26311v1 Announce Type: new Abstract: Knowledge distillation is widely used to transfer capabilities from teacher models to student models, but recent work shows that it can also transfer unintended teacher properties. We study whether different hidd