Exact-Solution Volume and Length Generalization in Transformers.
arXiv:2610.07676v1 Announce Type: cross Abstract: Research on transformer expressivity shows whether a transformer is capable of solving a given task, but gives little indication of whether the solution, if learned, is generalizable to longer input lengths. We
arXiv cs.AIResearch source·