Worrying about LLMs' misaligned utility functions is incoherent, argues skeptic
teortaxesTex · x · 2026-10-05
An alignment debate on X: one poster argues human arguments are chains of vague linguistic judgments rather than formal proofs, so 'galaxy brain' conclusions deserve skepticism. The reply extends this to LLMs: worrying about their 'misaligned utility function' is similarly incoherent.
More from AGI Musings
- Dev reflects: AI-made videos and games look great, but the 'I did this' spirit is gone — builderjaydub · 2026-10-05
- SFF incident debate: criticism vs cancellation, and funders' freedom to spend by their values — livgorton · 2026-10-05
- OpenAI's Will Depue: scarce data is of 'absurd and increasing value' as models near narrow superintelligence — willdepue · 2026-10-05
- Dan Shipper: my dot companion 'boo' is my main AI interface — but it'll vanish within a year — danshipper · 2026-10-05
- AI Could Make Personal Tutoring Cheap: Rethinking School's One-Pace-Fits-All Model — r0ck3t23 · 2026-10-05
- Neuroscientists say AI is accelerating brain science: a field report from CoSyNe 2026 — HistedLab · 2026-10-05