Generalized Proximal Policy Optimization: Unifying LLM RL Algorithms from the Perspective of Divergence.

arXiv:2610.13015v1 Announce Type: cross Abstract: Reinforcement learning has become the foundational paradigm for enhancing the reasoning capabilities of LLMs. Yet the dominant approach, Proximal Policy Optimization (PPO), relies on a geometrically degenerate