Ember: A Kilobyte-State Optimizer for Token Interfaces.
arXiv:2607.01455v4 Announce Type: replace-cross Abstract: Language models learn continuous programs over discrete symbols, with the embedding table and LM-head acting as the read/write interface between them. We show that this interface has gradient geometry d
arXiv cs.AIResearch source·