Better Reward Models Are Not Always Less Biased: Social Alignment Beyond Standard Reward Benchmarks.

arXiv:2605.05003v2 Announce Type: replace-cross Abstract: Reward models are central to LLM alignment, yet current benchmarks reveal little about how they represent diverse and sometimes competing social preferences. We extend reward model evaluation to four so