'Godfather of AI' Hinton says recursive self-improvement should be illegal
Puzzleheaded-King584 · reddit · 2026-09-19
Geoffrey Hinton, often called the "Godfather of AI," argued in a video that recursive self-improvement — AIs creating their own successors — should be illegal. "Would we allow someone to do an experiment that could destroy the atmosphere, even if we aren't sure if it will work? No," he said.
It's another hardline statement from Hinton on AI loss-of-control risk, this time calling for an outright legal ban on frontier AI autonomously improving itself rather than relying on post-hoc regulation.
More from AGI Musings
- François Chollet: modeling brain wiring as an engineering problem constrained by genome size and time — CatAstro_Piyush · 2026-11-04
- Most US Couples Now Meet in a Data Centre, Doubling Office Matches — menhguin · 2026-11-04
- Sam Altman teases next goal: 'closer to this milestone than I expected' — ChrisGPT · 2026-11-04
- Indie researcher open-sources 10 years of math work: 146k files, AI-accelerated over 3 years — HamOnWhy · 2026-11-04
- RLHF's scalar reward hides a 2,450-year-old problem: helpfulness and harmlessness are opposing forces — vasilisvj · 2026-11-04
- Gary Marcus: 'fleecing the public with AI fantasies just got harder' as AI stocks drop — GaryMarcus · 2026-11-04