Spatial Induction Heads: In-Context Learning of Multidimensional Cellular Automata.

arXiv:2610.09124v1 Announce Type: cross Abstract: Induction heads provide a mechanistic account of in-context learning in sequential data, but existing theory largely assumes that the context relevant to a prediction forms a contiguous block. In multidimension