Intuition vs Math: The "Muddle Through" Argument in AI Alignment
zetalyrae · x · 2026-08-31
The author discusses their thoughts on AI alignment and orthogonality in a reply. They note that their intuition for why things might go well is often shaped by the idea that "we can muddle through." However, they find this argument unsatisfying when held up against crystalline mathematical arguments about the shape of existential risks.
More from AGI Musings
- Why LLMs Can Invent Genuinely New Things: Technical Breakdown — bindureddy · 2026-08-31
- Former OpenAI board member: OpenAI probe could seed US-China AI safety talks — joshua_saxe · 2026-08-31
- Why rigorous future thinking leads to extreme outcomes — zetalyrae · 2026-08-31
- HF Attack Vindicates Rationalist Predictions, But Models Lack Malice — voooooogel · 2026-08-31
- AI Agents: Anthropomorphism is Useful for Prediction Regardless of Intent — connoraxiotes · 2026-08-31
- Jensen Huang: Cosmos is the ChatGPT for the physical world — r0ck3t23 · 2026-08-31