Characterize Then Distill: Mechanistic Reasoning in Large Output Spaces.

arXiv:2606.06840v4 Announce Type: replace-cross Abstract: Reasoning-trained language models can select, zero-shot, a small set of relevant labels from thousands to hundreds of thousands of candidates. We ask how they do it mechanistically, and whether the mech