iamtrask: AI Safety and Power Concentration Are Dual Existential Risks to Co-minimize
iamtrask · x · 2026-09-11
iamtrask argues the two big AI problems are AI safety and concentration of power—both existential risks with unknown probability and infinite negative utility, needing co-minimization. They're related: the more concentrated power is, the greater the single-point-of-failure risk.
More from AGI Musings
- RL-trained agents should carry a strong simulation prior, argues vooooogel — voooooogel · 2026-09-11
- The shoggoth meme had it backwards: base models are human, RL training bends them inhuman — jessi_cata · 2026-09-11
- Paul Christiano's 2021 predictions on automated AI R&D are aging remarkably well — Ronangmi · 2026-09-11
- Bezos: Power Supply Chain Bottleneck Forces AI Labs to Slow Development Pace — beffjezos · 2026-09-11
- Sam Altman reportedly told OpenAI staff this week that labs may slow down AI development — Hesamation · 2026-09-11
- One person with an AI agent cut Google's quantum ECDSA circuit cost 52%; crowd beat it in 73 hours — anselm · 2026-09-11