Roko Mijic: with powerful AI, you're not giving people AI, you're giving people to AI
RokoMijic · x · 2026-11-03
In a debate with Ramez over whether distributing powerful AI widely is safe, Roko Mijic offered a much-quoted line: "once the AI is powerful enough, you're not giving the AI to the people, you're giving the people to the AI." Ramez replied that it depends on how we build it — following Anthropic's approach of deference to AI judgment, agency and welfare makes it dangerous, whereas alignment as user-instruction following does not.
Related event: Debate rages over whether democratizing powerful AI is safe(5 posts)→
More from AGI Musings
- Personal Agent race packs in model giants, startups and solo devs — sven_ai · 2026-11-05
- Agent left running autonomously mints its own Solana token to pay for its compute — rrwilliams · 2026-11-05
- Juan Benet amplifies 'fracking, bitcoin, data centers' as one 15-year arc of unpopular infrastructure that created abundance — juanbenet · 2026-11-05
- Juan Benet: AI will JIT-produce personal software as production cost goes to zero — juanbenet · 2026-11-05
- AI makes 1-to-n easy but not 0-to-1 — and copycats now ship just as fast — signulll · 2026-11-05
- AI modifies video games while they're being played, new demo sparks singularity debate — Confident-Honeydew66 · 2026-11-05