Dan Faggella: Even Pausing AGI Won't Stop Radical Change From Current AI
danfaggella · x · 2026-11-18
AI ethicist Dan Faggella, who pushed for AGI red lines at the UN General Assembly and has long advocated a slowdown, argues that pausing next-gen models won't prevent radical change: businesses will need AI running marketing and procurement in real time just to stay competitive, and identities and power structures will shift regardless.
Citing his video essay "Radical Change Will Be Foisted Upon Us," he rejects the common framings (AGI keeps humans as pets, AGI kills us all, or no AGI and humans live happily ever after) as less likely than a fourth scenario: something like AGI gets built — with or without international governance — and humans must evolve far faster than biological evolution allows to retain any extended relevance or influence in the new intelligence regime. He suggests dedicating a share of our attention to "what are we building / becoming?"
More from AGI Musings
- Claude already contributes to ~25% of Anthropic's R&D amid accelerating AI race — emmanuelvivier · 2026-11-18
- Reddit debate: If AI may take our jobs, why not build a no-work society instead? — say-what-floris · 2026-11-18
- Real AI safety risk is a feudal system by big players, doomer policy doomed to fail — ctjlewis · 2026-11-18
- AI prototypes that look shippable: design teams worry about false signals of completeness — round · 2026-11-18
- Baidu CEO warns AI penetration 'fell short of expectations'; Marcus mocks trillion-dollar IPOs — GaryMarcus · 2026-11-18
- IMF: Circular AI deals top $1 trillion, about two-thirds borrowed — GaryMarcus · 2026-11-18