Knowledge Acquisition During Pre-training? Large Language Models Learn Better With Auxiliary Views.

arXiv:2609.04180v2 Announce Type: replace-cross Abstract: Gaps remain in our understanding of how large language models (LLMs) acquire knowledge during pre-training. We find that auxiliary views, conceptual reformulations, are key to this process. We design co