From Copying to Composition: How Language Models Develop In-Context Learning.

arXiv:2610.19113v1 Announce Type: cross Abstract: In-context learning (ICL) allows language models to adapt their behavior from instructions and demonstrations in a prompt, but accuracy alone does not reveal how contextual information controls their prediction