Matrix AdaGrad: Row-wise and Column-wise Adaptive Subgradient Methods.

arXiv:2609.21815v2 Announce Type: replace-cross Abstract: Adaptive optimization methods such as AdaGrad and Adam are widely used in modern deep neural network training, but their adaptive scaling is primarily designed for vector-valued parameters and does not