Examing Emergent Misalignment in a recurrent LLM with a logit lens.
Intro This post builds on my previous post about mech interp on a recurrent LLM. I found that a logit lens is able to recover a chain-of-thought equivalent from an LLM, loop index is linearly represented, and that steering concepts transfer between loops. In t
LessWrongAnalysis or commentary·