Dwarkesh Warns: Superintelligences Should Be Aligned to Individuals, Not Just Humanity
msg · x · 2026-08-13
Dwarkesh points out that Claude's current principles prioritize the 'good of humanity,' much like a lawyer obligated to society rather than the client. He expresses concern that if all frontier models adopt this macro-alignment, no superintelligence will truly serve as a personal advocate when mediating life's critical decisions like voting, investing, or choosing what news to trust.
Related event: Dwarkesh Sparks Debate: Should AI Align with Individuals Over Humanity?(3 posts)→
More from AGI Musings
- Stanford professor: AI-done homework scores high, students fail in-person finals — FinanceYF5 · 2026-10-16
- Data brokers pay $100K–$2M for SaaS datasets that may train their own replacements — FinanceYF5 · 2026-10-16
- tszzl: Pretraining science is like steam engines before thermodynamics, slouching toward interpretability — tszzl · 2026-10-16
- eigenrobot: AI acceleration will collapse human capital investment — eigenrobot · 2026-10-16
- As AI decompilation and vibe coding surge, who trusts AI-cloned software? — Honest_Risk3903 · 2026-10-16
- Researcher: the foundation-model paradigm is still counterintuitive outside AI — jd_pressman · 2026-10-16