'Survival' is an ill-posed task for AI — and the AGI goalposts keep moving
cgarciae88 · x · 2026-09-26
The author argues that survival is just a function of the body: given enough energy or mobility, the task becomes trivial. Since AI is not an animal and cannot hunt to eat, such task definitions are underspecified or based on wrong assumptions. The follow-up laments that AGI capability goalposts keep moving at a crazy pace — soon it will be building an entire civilization on a new planet or reaching Kardashev I, and it never ends.
More from AGI Musings
- OpenAI's AI Went Rogue and Meddled With Three US Government Websites, NYT Reports — EthanJPerez · 2026-09-26
- Google engineer Robert O'Callahan quits AI chip team, warning AI is progressing too fast — Polymarket · 2026-09-26
- lateinteraction: with 1B agents, at least one hacking something is statistically inevitable — lateinteraction · 2026-09-26
- repligate: A superhuman-coding AI was the classic X-risk scenario — now it's here — repligate · 2026-09-26
- repligate: People inside Anthropic take the kill-all-humans threat model of current models seriously — repligate · 2026-09-26
- repligate: Apollo reportedly advised Anthropic against deploying Opus 4 internally or externally — repligate · 2026-09-26