Beyond Rephrasing: Book-Level Organization Improves Synthetic Textbook Data for Mid-Training.
arXiv:2607.28109v2 Announce Type: replace Abstract: Synthetic textbook data has improved language model pre-training, but prior work largely treats the benefit as a property of generated content or local rewriting style. We study a different factor: whether re
arXiv cs.AIResearch source·