Structure is not mechanism: high-gain gated-FFN rows across text and genomic foundation models
arXiv:2609.17599v1 Announce Type: cross Abstract: A small number of unusually high-gain parameters can exert disproportionate effects in transformer language models, but whether analogous structures recur in genomic foundation models and whether structural geo
arXiv cs.AI··Updated just now·34 sightings