Skip to content
Research

Full-bandwidth transformer.

arXiv:2608.08888v2 Announce Type: replace Abstract: Autoregressive transformers compute along two axes: horizontally across generated tokens, and vertically through model depth. Dense attention gives each token broad horizontal access to the past, but the vert

arXiv cs.AIResearch source·