When LLM Reward Design Fails: Diagnostic-Driven Refinement for Sparse Structured RL.

arXiv:2605.28918v2 Announce Type: replace-cross Abstract: For sparse, structured reinforcement-learning tasks with semantic reward-function interfaces, LLM-generated reward shaping is better framed as debugging than one-shot generation. We study PPO-trained ag