Possible Minds May Be Narrower Than Yudkowsky Thinks, Challenging Orthogonality
jd_pressman · x · 2026-10-08
The author pushes back on the orthogonality thesis: the space of practically possible minds may not be as wide as Eliezer Yudkowsky assumes in The Sequences. Goal space is probably wide, but most of human goal space consists of instrumental goals, which cuts against orthogonality.
Related event: Revisiting the Orthogonality Thesis: AI Minds and Morality(2 posts)→
More from AGI Musings
- Kevin Roose puts AI apocalypse odds at 10%, publishes new book The AGI Chronicles — kevinroose · 2026-10-08
- The Hard Problem of consciousness as a 'water is wet' meme, mapped to four camps — burny_tech · 2026-10-08
- OpenAI math problem #109 tightened ~570-million-fold via nonadjacent axis swaps — aran_nayebi · 2026-10-08
- 'What EA/AI safety folks miss is…': the tell that you're retreading old literature — JacquesThibs · 2026-10-08
- If AI automates math, the frontier shifts from solving problems to asking deeper ones — xwang_lk · 2026-10-08
- Self-Copying AI Breaks One-Person-One-Vote: Social Theory Needs a Rework — jacyanthis · 2026-10-08