From alignment to self-augmentation: how the AGI discourse flipped in five years
danfaggella · x · 2026-10-14
Dan Faggella contrasts the industry mood at two points in time:
- 2022: people realized AGI might eventually escape human control, so the conversation was about AGI risk and "alignment" approaches.
- 2027: people now assume AGI is probably coming and isn't align-able, so the conversation has shifted to how humans can augment themselves to stay competitively viable.
The juxtaposition highlights a stark drift: mainstream discourse has moved from "how do we control AGI" to "how do we avoid being left behind," implying alignment has been quietly written off.
More from AGI Musings
- PhD students torn between pumping out AI-assisted papers and real skill-building — SeaAccomplished441 · 2026-10-14
- If an AI helps discover a drug, who gets credit? — yi111 · 2026-10-14
- Decision theory debate: does TDT give in to blackmail? Self-modifying CDT complicates the answer — jessi_cata · 2026-10-14
- Aggregating global compute for open superintelligence is now near-consensus — willcb · 2026-10-14
- Robert Wright's AI book The God Test now out in Chinese translation — wfithian · 2026-10-14
- Mike Knoop's 2026 AI disruption list: coders stop reading code, math falls — mhmazur · 2026-10-14