MoRE: Mixture of Reused Experts.
arXiv:2609.18176v2 Announce Type: replace-cross Abstract: Mixture-of-Experts (MoE) architectures decouple model capacity from computational cost, yet incur high memory footprints as parameters grow linearly with the number of experts. Recurrent Transformers ac
arXiv cs.AIResearch source·