AFCS: Atomic-Fact-Conditioned Synthesis for Factual Knowledge Pretraining.

arXiv:2610.20086v1 Announce Type: cross Abstract: Synthetic data is increasingly used in language-model pretraining. Existing knowledge-corpus synthesis pipelines, including WRAP and Nemotron-CC, usually take a source passage or document segment as input and g