Fast Rates for Offline Q-Learning with KL Regularization.

arXiv:2610.18839v1 Announce Type: cross Abstract: This paper investigates offline Q-learning for finite-horizon Markov decision processes with Kullback-Leibler (KL) regularization. Recent studies have shown that KL regularization can yield fast rates in offlin