AdamPM: Memory-Efficient LLM Optimization via Moment Pooling.

arXiv:2610.24598v1 Announce Type: cross Abstract: Adam is widely used for training large language models (LLMs) owing to its strong optimization performance and training stability, but its element-wise estimation for the first and second moments incur substant