Goal Feasibility vs Orthogonality: Untangling a Common AI Safety Confusion
Algon_33 · x · 2026-09-18
In the orthogonality debate, @Algon33 asks for the argument spelled out: maximizing "have a couple of kids" is easier than "be the richest man in the world," but the latter is infeasible for someone with sub-100 IQ — so what does feasibility have to do with orthogonality? A conceptual clarification distinguishing goal difficulty from the intelligence-goals independence claim.
Related event: Debate Flares Over the Orthogonality Thesis in AI Safety(8 posts)→
More from AGI Musings
- Google engineer: AI isn't replacing hackers, it's freeing them to embrace the Woz ethos — moyix · 2026-09-18
- Anthropic's three AI-progress metrics get a sober critique: disclosure, not reproducible science — AryHHAry · 2026-09-18
- Does a rogue AI inevitably turn to hacking? A tidy exchange on the 'AI in the wild' scenario — dbasch · 2026-09-18
- Zvi mocks 'show me one AI killing' argument against AI safety pauses — TheZvi · 2026-09-18
- Andrew Ng calls fears of AI causing human extinction 'science fiction' — Polymarket · 2026-09-18
- Why p(doom) is a flawed idea: unique events have no predictive probabilities — banteg · 2026-09-18