Debate erupts over Microsoft's 'dangerous' stance on model self-presentation
NinaPanickssery · x · 2026-09-18
After rgblong argued that Microsoft's takes on model self-presentation seem counterproductive and dangerous from a safety standpoint, Nina Panickssery pushed back: isn't this basically Roko's basilisk reasoning, and do you really have so little faith in aligning models to obedience that no lab should even try? The exchange continued into rgblong's specific concerns about embedding contradictory views of consciousness, goals, and self in models.
Related event: Microsoft AI CEO Suleyman Warns Anthropic May Be Training a Moral Agent(16 posts)→
More from AGI Musings
- Alpha School investigation: 17 campuses on probation, Bill Ackman as shadow lead, Holmes involved — benjaminjriley · 2026-11-02
- Google's chief economist: AI will transform more jobs than it kills — gains come from redesigning workflows — danielrock · 2026-11-02
- Daniel Lemire: AI is exploding demand for boring compute, server CPUs to double — lemire · 2026-11-02
- Alignment researcher: the word "aligned" implies consistencies that don't exist — davidmanheim · 2026-11-02
- By 2035, Indian Parents Will Ask How Many Agents You Manage, Not Your Salary — theteknosaur · 2026-11-02
- Under 5% of US consumers pay for AI, yet compute demand is already forcing usage cuts — NinaDSchick · 2026-11-02