When to Stop Penalizing Actions? Martingale GRPO for VLA Reinforcement Learning.

arXiv:2610.32431v1 Announce Type: new Abstract: A failed vision-language-action (VLA) rollout does not imply that every action contributed to failure. Yet in group-relative policy optimization (GRPO), a single trajectory-level advantage is assigned to all acti