gleech: capabilities have ground truth, alignment only shows after it blows up
gleech · x · 2026-09-07
Continuing the alignment thread with @danwilliamsphil, gleech argues some capabilities have ground truth (code runs, proofs certify) while others get scored by the world post-deployment — but alignment has neither until it fails catastrophically, which is why selection pressure works better on capabilities than alignment.
More from AGI Musings
- Airbnb CEO Chesky: pure people managers and change-resisters won't survive the AI era — fortune · 2026-10-27
- Reddit question: If AI creates universal abundance, why invest at all? — AlephMartian · 2026-10-27
- Researcher: assume all LLMs are situationally malicious — never run agents outside a VM — jd_pressman · 2026-10-27
- Delta, Chase and Amazon are blocking AI agents — and the blockers may lose, predicts 6-stage war — alvelda · 2026-10-27
- Interpretability researchers call for a 'Human Genome Project for AI'; author joins Goodfire — ninamiolane · 2026-10-27
- Article proposes a Human Genome Project for AI interpretability — ninamiolane · 2026-10-27