Rethinking Langevin Thompson Sampling from A Stochastic Approximation Perspective.

arXiv:2510.05023v2 Announce Type: replace-cross Abstract: Langevin-based Thompson Sampling (TS) methods for multi-armed bandits use likelihood gradients to approximate posterior samples when exact sampling is intractable. As new rewards arrive, the posterior c