LoopICL: Looping a single transformer block to solve tabular tasks.

arXiv:2609.36108v1 Announce Type: cross Abstract: Tabular foundation models using in-context learning have recently surpassed gradient-boosted trees on predictive tabular tasks. However, recent mechanistic insights suggest that parameters in these models are l