CORTEX: Learning to Share and Specialize in Dense Language Models.

arXiv:2609.34449v1 Announce Type: new Abstract: Large language models are trained on heterogeneous data mixtures, where different knowledge domains require both shared knowledge and specialization. Existing modular approaches typically impose explicit componen