OpenAI Chief Scientist Pachocki: Racing Into RSI Is an Unprecedented Folly
Puzzleheaded-King584 · reddit · 2026-10-13
OpenAI's chief scientist Jakub Pachocki (confirmed by roon) called racing into recursive self-improvement "a folly unprecedented in world history," noting no fundamental alignment advances since RLHF nine years ago.
He writes that no lab has solved alignment and monitoring well enough to keep scaling at maximum speed responsibly, hopes voluntary slowdowns become commonplace until shared safety bars exist, and urges international coordination on AI development as a top government priority. roon stressed the author is among the field's most respected scientists.
Related event: Alignment stagnation debate erupts as OpenAI chief scientist weighs in(19 posts)→
More from AGI Musings
- Consciousness is a verb, not a transferable noun — why AI cannot have it — AnnaCiaunica · 2026-10-14
- "Documents Aren't Knowledge": preserving reasoning, provenance and uncertainty, not just outputs — jteevan · 2026-10-14
- David Patterson: Microsoft, Apple lag on SI because they can't disrupt themselves — davidpattersonx · 2026-10-14
- Microsoft Research's 7 predictions: reading becomes asking, meetings become return places — jteevan · 2026-10-14
- Why Microsoft, Apple, and Google can't win AI: Christensen's disruption theory — davidpattersonx · 2026-10-14
- Caltech's Hirosi Ooguri on whether AI can discover physics before we do — TOEwithCurt · 2026-10-14