RESEARCH LEAD STORYFunction Lives Where Variance Doesn't: Task-Weighted Charts of a Language Model's Computation
How many dimensions does a language model's computation actually use? The question is ill-posed until one names a functional. Task-weighted charts make it well-posed: low-dimensional coordinate systems fit against a chosen functional of the representation, und