Skip to content
Research

Beyond Rephrasing: Book-Level Organization Improves Synthetic Textbook Data for Mid-Training.

arXiv:2607.28109v2 Announce Type: replace Abstract: Synthetic textbook data has improved language model pre-training, but prior work largely treats the benefit as a property of generated content or local rewriting style. We study a different factor: whether re

arXiv cs.AIResearch source·