Relative Generalization Invariance of LLM Pretraining.

arXiv:2609.33016v1 Announce Type: cross Abstract: Large Language Model (LLM) pretraining performance is jointly shaped by three components of the training triplet: the optimizer, model architecture, and training data stream. However, how these components influ