Beyond Reward Scoring: Online Multi-Agent Preference Learning for Multimodal Response Generation.

arXiv:2610.23256v1 Announce Type: new Abstract: Multimodal preference alignment often follows a score-based RLHF pipeline: a reward model is first trained to learn human preferences, then used to score on-policy responses and optimize the response model's gene