Erik Hoel essay: It's time to ban smart machines from making smarter machines
erikphoel · x · 2026-09-19
Cognitive scientist Erik Hoel publishes a long-form Substack essay arguing recent AI breakthroughs have erased his skepticism about near-term AI capabilities, and calling for a halt to compute scaling and to machines improving machines.
- Even frozen at current compute levels, he claims humanity could secure an incredible century of human-led medical and scientific progress without surrendering agency.
- He warns that un-throttled AI ends in total human disempowerment, invoking the Flight 93 passengers' choice as a metaphor for ordinary people 'storming the cockpit' via legislation.
- He concedes the hard problem: a domestic ban won't stop state-backed rivals, so without an enforceable global consensus a localized halt risks leaving democratic nations behind.
More from AGI Musings
- Andrew Yang hears of orgs cutting AI token spend on low ROI; Gary Marcus calls betting the economy on it bonkers — GaryMarcus · 2026-09-19
- Rant Against Both Copyright Holders and AI Firms: 'No 200-Year Hostage Over Civilization' — TinfoilTricorn · 2026-09-19
- 'The craft of writing code will disappear': bold prediction on AI coding sparks debate — Aizkmusic · 2026-09-19
- ICLR 2027 hits 62K+ submissions, peer review faces its biggest stress test yet — sivareddyg · 2026-09-19
- 'I can just ask AI myself': how AI is undercutting freelance consultants — SuB8u · 2026-09-19
- Bold prediction: cures for every disease by 2030 — davidpattersonx · 2026-09-19