The orthogonality thesis debate: where alignment skeptics and MIRI actually diverge
EigenGender · x · 2026-09-14
- The author's fundamental disagreement with MIRI: there is no arbitrary measure over mind space, and current trajectories suggest a high likelihood of building an ASI that loves humans "by accident."
- They argue discussion of the orthogonality thesis shows a motte-and-Bailey pattern: MIRI-aligned people seem to believe a strong version (intelligence and goals are fully independent), while debate often retreats to weaker formulations.
More from AGI Musings
- What is work for? Cross-national survey of 8,234 adults on meaning in the AI age — soumitrashukla9 · 2026-10-31
- Which universities win top students may hinge on healthy AI-use boundaries, argues researcher — brianryhuang · 2026-10-31
- Researchers debate whether more inference compute can substitute for training compute — teortaxesTex · 2026-10-31
- Five agents can agree because they made the same mistake, krishnan warns with satire — krishnan · 2026-10-31
- Google's earnings offer clearest look yet at the cruel economics of AI search — dinabass · 2026-10-31
- Dartmouth provost who warned of AI cheating resigns over undisclosed AI use — Ars Technica AI · 2026-10-31