Many Preferences, Few Policies: Compact Portfolios for Multi-Objective LLM Alignment.

arXiv:2604.04144v3 Announce Type: replace-cross Abstract: Aligning large language models (LLMs) requires balancing competing objectives such as helpfulness, harmlessness, and conciseness. The appropriate balance varies across users and applications, yet traini