Beyond Token Scale: Chunk-Level Sparse Autoencoders for Reliable Semantic Feature Discovery.

arXiv:2609.35521v1 Announce Type: cross Abstract: Sparse autoencoders (SAEs) expose features that help us understand and steer language models, but faithful reconstruction does not guarantee informative concepts. Token-level objectives reward lexical and forma