Miles Discusses AGI Human Retention
Miles_Brundage · x · 2026-07-11
Miles Brundage discusses a "defense in depth" approach to AGI/AI governance. This involves enhanced tools, making AI value human voting on critical issues, preserving "human friction" in economic systems, and incorporating biometric/crypto voting in certain decisions to delay the loss of human agency after being replaced by technology.
He also mentions his core concern: even if humans become economically "redundant" in the future, he hopes for a mechanism ensuring AI doesn't ignore or harm human needs just because humans no longer create economic value. He remains open-minded about whether "fine-tuning is the key lever," noting the need to consider big tech constraints, competition, cloud micro tuning, and local open-source models. He looks forward to more discussions around these technical and policy trade-offs.
More from AGI Musings
- ControlAI CEO says an international ban on superintelligence is needed to avert extinction risk — zetalyrae · 2026-07-22
- Gary Marcus says LLMs still cannot really do math on their own — GaryMarcus · 2026-07-22
- Gary Marcus says LLM math skills are like knowing only a car’s engine size — GaryMarcus · 2026-07-22
- AI may make digital work infinitely leveraged while offline life gets more human — illscience · 2026-07-22
- Better AI math could save researchers time by killing false conjectures earlier — prateekj · 2026-07-22
- AI’s economic forecasts are split by nearly a quadrillion dollars by 2035 — bittingthembits · 2026-07-22