Yudkowsky defines 'powerful AGI': biotech 10 years ahead of human state of the art
teortaxesTex · x · 2026-11-22
Eliezer Yudkowsky offered an operational definition of "powerful AGI": an AGI is powerful if it can invent and deploy biotechnology at least 10 years ahead of the human state of the art — the threshold at which alignment becomes mandatory.
A replier quipped that Yudkowsky would change his mind once we safely create a cellular-level duplication of a strawberry, joking that Demis Hassabis and Isomorphic Labs could tackle it after curing cancer.
More from AGI Musings
- Mathematicians weigh in on Riemann Hypothesis breakthrough: a 25,000-page 'wormhole' through existing math — Vjeux · 2026-11-22
- Math paper volume jumped 30% with AI, but creativity didn't budge, compressibility study finds — jamestagg · 2026-11-22
- AI isn't the end of art: a Star Trek thought experiment on how art evolves — dreamwieber · 2026-11-22
- 'Intelligence can turn every person into a giant, or into a number' — Anthropic IPO reflection — markjeffrey · 2026-11-22
- Gary Marcus fires back: Claude Code is actually neurosymbolic AI — GaryMarcus · 2026-11-22
- The 70-year-old questions: Tokyo's CTG anticipated today's AI debates — Merzmensch · 2026-11-22