Algorithmic Scratchpads and Curriculum Staging for Arithmetic Reasoning in Tiny Transformers.

arXiv:2610.09003v1 Announce Type: cross Abstract: Autoregressive Large Language Models (LLMs) frequently struggle with deterministic multi-step algorithmic tasks such as multi-digit multiplication and long division. In this paper, we investigate the mechanics