Suan: Rectifying Direct Preference Safety Alignment in Large Language Models.

arXiv:2609.08634v3 Announce Type: replace-cross Abstract: Integrating robust safety guardrails into Large Language Models (LLMs) is essential for delivering helpful yet harmless responses. While proprietary systems exhibit reliable safety controls, their under