Frontier lab researcher: 'We don't know how to reliably instil values into AIs' — scientific consensus
wfithian · x · 2026-11-16
Frontier lab researcher Neel Nanda stated: "I work at a frontier lab, we do not know how to reliably instil values into the AIs, this is the scientific consensus." Gregory Conti retorted that a world where we did know how would also be bad — humans have deep conflicts over values, and we don't want superintelligent entities aligned with one nation or ideology — concluding there's no good future with AI and it should all be shut down. The thread captures the spectrum from 'alignment is unsolved' to full shutdown advocacy.
More from AGI Musings
- AI researcher says his job is now almost fully automatable with Claude Code — jonkhler · 2026-11-16
- Bank AI ROI: 80% Say It Works, Only 1% Can Prove It, Turrin Newsletter Finds — mikeflache · 2026-11-16
- Arrow's Impossibility Theorem Invoked to Argue AI Alignment Is Mathematically Impossible — mikeflache · 2026-11-16
- AI detection reveals many contemporary fiction professionals don't read or write — Afinetheorem · 2026-11-16
- dair-ai's top AI papers of the week: s3, AutoRefine, agent scaling — dair_ai · 2026-11-16
- Nina Schick: keeping AI out of China is impossible — the US must just build the best AI — NinaDSchick · 2026-11-16