Rethinking the Tradeoff Between Temporal Encoding and Nonlinear Computation in Spiking Language Models.

arXiv:2610.10933v1 Announce Type: cross Abstract: Spiking language models face a tradeoff between representing continuous semantic features over short temporal windows and retaining costly nonlinear attention operations. We introduce Spora, which jointly desig