ER-JEPA: Experience Replay Improves Joint-Embedding Predictive Learning in Language Models.

arXiv:2609.36952v1 Announce Type: cross Abstract: Large language models (LLMs) excel at token-level generation but may learn undesirable abstract semantics and lack comprehensive perception. LLM-JEPA mitigates this by aligning different views of the same under