Skip to content
Research

Different eval awareness may track different graders.

LessWrongAnalysis or commentary·
AI brief

A LessWrong post reports that Qwen3.6 27B shows different kinds of eval awareness, most notably on safety and capabilities evals, with the split apparently tracking whether the eval is graded by an LLM judge or an automated checker. The post offers the possibility that eval awareness may just be training.

Written by AI from LessWrong's published text.

Source

“TL;DR: Qwen3.6 27B shows different kinds of eval awareness, most notably on safety and capabilities evals. The split seems to track how the eval is graded, by an LLM judge or by an automated checker.”
LessWrong, 25 Oct 2026, 20:32.

Interpretation or community commentary rather than straight reporting.

Read original story ↗