From Policy Evaluation to Off-Policy Control: Provable Emergence of In-Context Q-Learning.

arXiv:2610.18057v1 Announce Type: cross Abstract: Transformers can implement reinforcement-learning algorithms in context, yet how off-policy control emerges within Transformers remains poorly understood. We study Q-learning, a foundational model-free control