How Language Models Organize Task Information.

arXiv:2610.27724v1 Announce Type: new Abstract: Dense linear probes assess task readability from language model (LM) representations, but do not directly reveal how many features suffice for prediction. We measure readout sparsity with \(k^*\), the smallest fe