AI brief
A LessWrong post describes MATS research on how reinforcement learning can work against character training in models, such as when a grader or coding task rewards misbehavior.
Written by AI from LessWrong's published text.
Source
“TL;DR Research done as part of MATS. See here for the full paper. Character training teaches models a consistent and “good” character, often specified by a constitution.”
Interpretation or community commentary rather than straight reporting.
Read original story ↗