On the Convergence of Semi-Gradient TD: A Mean Field Perspective.

arXiv:2610.20014v1 Announce Type: cross Abstract: Semi-gradient temporal-difference learning is a core algorithmic component of reinforcement learning, but bootstrapping with function approximation generally induces a non-conservative vector field and can lead