Zvi on OpenAI chief scientist Jakub Pachocki's warning about monitorability
TheZvi · x · 2026-09-08
Zvi Mowshowitz publishes a long-form analysis, "An Alien Mind: Jakub Pachocki Warns Us," dissecting OpenAI chief scientist Jakub Pachocki's full position. Key threads: alarming lack of monitorability in Astra's architecture — briefly appearing worse after leaked architectural changes, prompting Pachocki to head off a potential race-to-the-bottom on monitorability; the branching of the tech tree and why "universally better" isn't required; alignment's target problem; the case against pausing; pacing the next frontier; and pointed criticism of OpenAI's internal dynamics. Zvi calls it an excellent warning and will follow up on monitorability's contributing factors.
More from AGI Musings
- AI commentator: GPT 5.2 was first spark of superhuman intelligence, economic boom felt this year — teortaxesTex · 2026-09-08
- Hinton warns superintelligence could lead to human extinction; critics demand a plausible scenario — AIandDesign · 2026-09-08
- "Sex with a robot" conflates two distinct ethical questions, argues AI researcher — repligate · 2026-09-08
- Fei-Fei Li: AGI is a marketing term, not a scientific one — ziv_ravid · 2026-09-08
- AI reshapes non-tech companies: owning product/engineering there has never been more valuable — davemccollough · 2026-09-08
- Blogger Explains His Journey From AI Optimist to AI Doomer — zetalyrae · 2026-09-08