How High Is 0.6? Floors, Ceilings, and Headroom in Interpretability Probing.

arXiv:2610.08544v1 Announce Type: cross Abstract: Probes are the workhorse of interpretability. If a model's hidden states predict a variable, the model is said to represent it. But a probe score has no fixed meaning. An $R^2$ of 0.6 may only reflect what the