AI Safety Circle Debates Whether RL Brings Alignment Problems Back
Scott Alexander recalled his 2019 conversation with Buck, arguing RL brings alignment problems back in line with his expectations. repligate criticized the safety community for stigmatizing 'Plan C' despite better-than-expected alignment progress, while others argued RLVR won't necessarily create alien goal-seekers since AI is already shaped by billions of human interactions.
2026-11-02 ~ 2026-11-02 · 3 related posts
- Episode 1: Scott Alexander's "Against SURA" Sparks Fierce AI Safety Debate(2026-11-01, 21 posts)
- Episode 2: Scott Alexander's Defense of AI Handover Sparks Heated Debate(2026-11-02, 2 posts)
- Episode 3: AI Safety Circle Debates Whether RL Brings Alignment Problems Back(2026-11-02, 3 posts)
- repligate: AI safety community is discarding Plan C, even as alignment goes better than expected — repligate · 2026-11-02
- Scott Alexander: a 2019 dinner prediction about RL turning tool AIs into agents still holds — slatestarcodex · 2026-11-02
- Why RLVR may not turn AI into alien goal seekers: billions of human interactions are shaping it — Danmar_here · 2026-11-02