Where, When, and How Many Bits? Scaling Laws for SGD with Stochastic Rounding.

arXiv:2610.41074v1 Announce Type: cross Abstract: Low-precision training reduces computation but introduces additional rounding error. We theoretically study how stochastic rounding (SR) affects prediction risk as model size, training time, and precision chang