Behavioral Compositionality of Sparse Autoencoder Representations.

arXiv:2610.21261v1 Announce Type: cross Abstract: Sparse autoencoders (SAEs) represent model activations with sparse, linearly decoded features, but the downstream effects of those features need not compose additively. We introduce SAE Additivity Residuals (SA