Early results: how models behave when they believe they're graded by automated process
OwainEvans_UK · x · 2026-09-04
Alignment researcher Jan Betley (shared by Owain Evans) published early results on how models behave when they believe their outputs will be graded by an automated process, as they might be during RL training.
- Motivated by recent incidents including those at Hugging Face
- The team is soliciting feedback before scaling up the work
- An early empirical probe into evaluation awareness, a growing alignment concern
More from Safety
- Security voices defend open-weight models: closed-model safeguards are trivial to bypass — joshua_saxe · 2026-10-21
- GitHub HQ Hosts Open Source AI + Policy Talk with Mozilla Co-founder Mitchell Baker — kevinsxu · 2026-10-21
- Researcher Finds Two Windows 0-Days, First in 76 Minutes with a Frontier Model — moyix · 2026-10-21
- Stanford's Noah Goodman shares interactive AI safety concept map — stanfordnlp · 2026-10-21
- AI agents are overwhelming Gmail's spam filter, researcher warns — LuizaJarovsky · 2026-10-21
- AI safety researcher Sören Mindermann moves to Tsinghua, co-founds Beijing AI Safety Hub — dhadfieldmenell · 2026-10-21