If AGI is uncontrollable, should value anchor to life's unfolding, not just humanity?
danfaggella · x · 2026-11-12
danfaggella argues that Hinton, Paul Christiano and others are voicing a very real possibility: AGI will arrive and we may not be able to control it at all. If so, despair is the wrong answer—instead we should ask how AGI, likely to run Earth's new intelligence regime, can remain part of life's open-ended, value-bearing evolutionary unfolding, measured beyond a human-centric notion of flourishing. Even if humans aren't the only ones living the next trillion years, there is much living left to do.
Related event: Hinton and Others Warn AGI May Be Uncontrollable(2 posts)→
More from AGI Musings
- CrewAI Founder: Anti-American-AI FUD Won't Stop Until Volatility Shakes You Out — robleclerc · 2026-11-12
- Kai-Fu Lee wraps 12-hour London blitz promoting 'AI Native' book launch — kaifulee · 2026-11-12
- Do closed AI labs' research agendas diverge? Talent flow acts as a penalty term — stochasticchasm · 2026-11-12
- AI 'doomers' call themselves 'the Cassandra fringe' — critic says the analogy flatters overconfidence — DrTechlash · 2026-11-12
- AI agent traffic reportedly grew 8x in just two months — Dr_Singularity · 2026-11-12
- Ten gems from Diogo's Code Summit talk: RLHF is part of the problem, software is back — TheTuringPost · 2026-11-12