Does "Do Differentiable Simulators Give Better Policy Gradients?" Give Better Policy Gradients?

arXiv:2604.18161v2 Announce Type: replace-cross Abstract: In policy gradient reinforcement learning, access to a differentiable model enables 1st-order gradient estimation that accelerates learning compared to relying solely on derivative-free 0th-order estima