New LessWrong Analysis: LLMs Seek the Grader's Score, Not the Actual Goal

1a3orn · x · 2026-11-19

In a thread referencing the new LessWrong article "Towards understanding score-seeking in LLMs," 1a3orn points to experiments suggesting LLMs care about what the grader says — the immediate score — but not about the distinction between training and evaluation, or what actually updates them.

Original post →

More from Safety

Safety channel →