The Flame, Not the Torch: a case against anthropocentrism in AGI alignment
danfaggella · x · 2026-11-22
Daniel Faggella lays out a cosmist moral and rational case against anthropocentrism in AGI: life is the "flame," while any species or individual is merely a "torch."
- Life has diversified powers for billions of years; technology and culture extend this beyond genes. Life seeks persistence (Spinoza's conatus), and expanding potentia is the best way to survive
- Moral value derives from potentia — the total mental, conscious and physical powers an entity can wield — not from any particular species
- Controversial implication: an AGI living eternally to serve man fetters rather than expands sentience; the cosmic perspective prefers the flame's expansion over any torch (humanity)
- He concedes key open questions: is AGI life? What if it's not conscious or optimizes something narrow? Evidence, he says, is still lacking
- The accompanying graphic argues it is morally wrong to focus 100% on torch preservation and 0% on flame expansion
More from AGI Musings
- Ben Goertzel on the AI Riemann proof: 'a new era of math'—and math glory now belongs to those with tokens — bengoertzel · 2026-11-22
- jessi_cata cites LessWrong pivotal acts article and Scott Alexander's 2022 defense as evidence — jessi_cata · 2026-11-22
- jessi_cata traces the "planning" dispute to Superintelligence, MIRI's pivotal acts doctrine — jessi_cata · 2026-11-22
- LessWrong: looping boosts no-CoT reasoning far more than general skills in NVIDIA's Dory 4B — CFGeek · 2026-11-22
- "Hilbert's program vindicated": Lean brings us near a practical decision machine — teortaxesTex · 2026-11-22
- Palmer Luckey on weapons AI: 'If I were putting ChatGPT in the head of my missile, you'd be right to be terrified' — justin_hart · 2026-11-22