Multiscale Policy Optimization for Long-Horizon LLM Agents.

arXiv:2610.35013v1 Announce Type: new Abstract: Long-horizon LLM agents interact with their environments through complete assistant turns while generating each action token by token. We observe that critic values vary primarily across turns, motivating optimiz