Non-asymptotic Convergence of Average-reward Q-learning with Options.

arXiv:2610.20347v1 Announce Type: cross Abstract: We study the finite-sample convergence of Q-learning algorithms for the average-reward formulation of Reinforcement Learning (RL) with options. While options allow temporarily extended and hierarchical actions,