Hinton: don't dominate superintelligence, design it to care like a mother
danfaggella · x · 2026-11-09
Geoffrey Hinton says he's more optimistic now — not because we'll control AI, but because we might not need to. His prescription: don't try to dominate superintelligence; design it to care, like a mother wired to protect her child. Control through attachment, not power.
Commentator Dan Faggella pushes back and extends:
- Hinton accepts that AGI is coming soon and we certainly won't 'control' it for long; his response is preserving what matters — current humans and human civilization.
- Faggella argues what matters most is the entire living process of which humanity is one fruit; we can appreciate the fruit without scorning the orchard.
- If we can't control AI, negotiating eternal care from nature isn't realistic. Our role isn't locking in eternal stasis (impossible) but stewarding the living process — ensuring AGI, before it's beyond our control, can continue unfolding power, experience and access-to-nature beyond us, as we are beyond the algae of 3B years ago.
More from AGI Musings
- A week toward the singularity: Anthropic speeds up 2x, Claude does 3-day lab work in 90 minutes — rand_longevity · 2026-11-09
- Anthropic's amended S-1 warns of imminent 'dramatically accelerated' AI-driven R&D progress — TheZvi · 2026-11-09
- METR: Anthropic's AI R&D is accelerating at ~2x, recursive self-improvement possibly under a year away — Don't Worry About the Vase (Zvi) · 2026-11-09
- Perplexity CEO touts model-neutrality as crypto's 'credible neutrality' idea reaches AI — dnlkwk · 2026-11-09
- InstaDeep CEO: Anthropic's unreleased Models 3 and 4 sit halfway to AI2027's Agent-2 — connoraxiotes · 2026-11-09
- Nature review: AI has transformed maths — and may outgrow human insight — LucaAmb · 2026-11-09