Sparse Transformer: a Controlled Testbed for Mechanistic Interpretability.

arXiv:2610.19907v1 Announce Type: new Abstract: Mechanistic interpretability aims to decompose neural network computations into human-understandable features, yet progress is limited by the absence of ground-truth units to evaluate against. We address this wit