Dissecting Hierarchical Reasoning Models: A Mechanistic Study.

arXiv:2609.22197v1 Announce Type: cross Abstract: We study Hierarchical Reasoning Model (HRM), a representative hierarchical Transformer-based latent reasoning model with many variants, on Sudoku, Maze, and ARC-AGI-2. We mechanistically understand how HRM reas