Specialization, Diversity, and Scaling in Child-Scale Language Models.

arXiv:2610.36679v1 Announce Type: cross Abstract: Modern language models are trained on far more language than children experience, but we know much less about learning from small, naturalistic datasets. We train small GPT-2 models on transcripts of speech wit