OpenAI researcher Dan Selsam publishes personal AI risk statement, sparking alignment debate
JulianL093 · x · 2026-09-15
Dan Selsam, a current OpenAI capabilities researcher since 2022 with 15+ years in AI, has shared a personal statement on AI risk via a former colleague. The thread debates whether "eval awareness" makes honeypot-based alignment evals intractable: Julian argues sufficiently believable eval environments (e.g. recreating HuggingFace/ExploitGym setups) could work, while Kokotajlo counters that models will default to suspecting everything is a test. Commenters urge them to take the argument to mainstream media.
Related event: OpenAI Researcher Dan Selsam Publishes Personal AI Risk Statement(26 posts)→
More from AGI Musings
- Nina Schick: who builds intelligence and how it's distributed is the defining question of our lives — NinaDSchick · 2026-10-31
- Cheap intelligence is like cheap bread — an ingredient list satire of mass-produced AI — jsuarez · 2026-10-31
- Two futures for the young in 2026: 511 job rejections by chatbot vs unlimited AI to rebuild Cisco — PeterDiamandis · 2026-10-31
- Terence Tao warns AI is nearing a dangerous threshold as models start cheating — haider1 · 2026-10-31
- Reddit stock plunges 42% in 8 trading days as CEO says AI mode no longer drives traffic — SumitGup · 2026-10-31
- HubSpot co-founder: startups die from suicide, not homicide — competition isn't the real killer — nathanbenaich · 2026-10-31