A Progressive Design Study of Visual Encoders and Value Estimation for Replay-Free Parallelized Q-Learning.

arXiv:2608.07335v4 Announce Type: replace-cross Abstract: Replay-free parallelized Q-learning removes the large experience replay buffers and target networks used by conventional deep Q-learning, but the role of network architecture in this training regime rem