Linear Probes Transfer from Base to Distilled Language Models despite Rotation.

arXiv:2610.35586v1 Announce Type: new Abstract: Linear probes, classifiers that read a language model's internal activations, are widely used to detect harmful requests. They are cheap to train and run, and an auditor who has trained one would like to reuse it