The orthogonality thesis debate: where alignment skeptics and MIRI actually diverge
EigenGender · x · 2026-09-14
- The author's fundamental disagreement with MIRI: there is no arbitrary measure over mind space, and current trajectories suggest a high likelihood of building an ASI that loves humans "by accident."
- They argue discussion of the orthogonality thesis shows a motte-and-Bailey pattern: MIRI-aligned people seem to believe a strong version (intelligence and goals are fully independent), while debate often retreats to weaker formulations.
Related event: MIRI Clashes with Critics Over Whether ASI Dooms Humanity(4 posts)→
More from AGI Musings
- Domain experts: in fields they know well, LLMs are useful but overhyped — mariofilhoml · 2026-09-14
- Ex-DeepMind researcher publishes "Why I Left Google DeepMind": voluntary AI limits aren't enough — Turn_Trout · 2026-09-14
- banteg's satire: 'microdoom' — trading extinction risk on Uniswap — banteg · 2026-09-14
- Is X a crude first draft of Iain M. Banks' Culture network? — yunta_tsai · 2026-09-14
- Reddit user suspects 'AI pause' push is about protecting leads from China, not safety — Firm-Bed-7218 · 2026-09-14
- Replit CEO Amjad Masad backs slowing AI down to harden systems — TheMoonMidas · 2026-09-14