The only job left is defining what is Good, argues alth0u in alignment musing
repligate · x · 2026-09-18
In a reposted thread, alth0u argues that once model capabilities converge, the remaining job is defining what is Good—which requires frequent interaction with the real world and consensus-building with others doing the same. That bottleneck, he says, is clear and largely unsolved.
More from AGI Musings
- "Parents liable for children" signs in Austria spark call to hold AI labs accountable — cnakazawa · 2026-09-18
- Anthropic says 80% of Claude's own code is now written by Claude — chrismattmann · 2026-09-18
- ArXiv 'proof' posts with undefined basics flood timelines, researcher warns of math slop — _onionesque · 2026-09-18
- 'Isn't managing the job?' — pushback on managers panicking over AI slop — beglen · 2026-09-18
- AI safety debate in one joke: engineers say air-gapped, alignment folks say "what if it could" — basedjensen · 2026-09-18
- Turning Yang-Mills existence and mass gap into a formal conjecture is AI math's ultimate test — geoffreyirving · 2026-09-18