Fully Interpretable Minimal Transformers: From Geometry to Algorithm.

arXiv:2610.09838v1 Announce Type: cross Abstract: We present a framework for building and interpreting minimal transformer models. By constraining a transformer's embedding dimension and head size to 2, we enable full two-dimensional visualization of its inter