Understanding In-context Learning of Addition via Activation Subspaces.

arXiv:2505.05145v4 Announce Type: replace-cross Abstract: To perform few-shot learning, language models extract signals from a few input-label pairs, aggregate them into a learned prediction rule, and apply this rule to new inputs. How is this implemented in t