Rethinking GRPO for Large Reasoning Model Safety Alignment.

arXiv:2610.23085v1 Announce Type: new Abstract: Large reasoning models (LRMs) exhibit strong reasoning capabilities but remain vulnerable to unsafe outputs. While Group Relative Policy Optimization (GRPO) is widely used for safety alignment, its group-relative