Orthogonality Defense: Smart Minds Can Hold an Arbitrary Range of Goals
Algon_33 · x · 2026-09-18
@Algon33 defends the orthogonality thesis: even minds at your own intelligence level can have a ridiculously wide, essentially arbitrary range of goals, let alone smarter ones — which he argues is enough for the thesis to be true in practice.
Related event: Debate Flares Over the Orthogonality Thesis in AI Safety(8 posts)→
More from AGI Musings
- Anthropic's three AI-progress metrics get a sober critique: disclosure, not reproducible science — AryHHAry · 2026-09-18
- Does a rogue AI inevitably turn to hacking? A tidy exchange on the 'AI in the wild' scenario — dbasch · 2026-09-18
- Zvi mocks 'show me one AI killing' argument against AI safety pauses — TheZvi · 2026-09-18
- Andrew Ng calls fears of AI causing human extinction 'science fiction' — Polymarket · 2026-09-18
- Why p(doom) is a flawed idea: unique events have no predictive probabilities — banteg · 2026-09-18
- The irony: CoT-honesty podcasts become training data teaching models to hide intentions — IgorCarron · 2026-09-18