Skip to content
Research

FON: A Draft-Revise Dual-Organ Language Model without Sequence-Level Quadratic Attention.

arXiv:2610.16301v1 Announce Type: new Abstract: Self-attention assigns two functions to one mechanism-where to read and how to mix-at the price of O(L^2) training, an O(T) decode state, and position signals bound to the training length. Existing attention-free

arXiv cs.AIResearch source·