Variational-Ising-Attention:Tailored Attention Matters for Science.

arXiv:2607.23634v2 Announce Type: replace-cross Abstract: Attention enables context modeling via query-key scoring with softmax normalization. Driven by industrial long-context demands, mainstream research has converged toward sparsity and efficiency, yet soft