Why ASI valence-flip arguments miss the point about Bing's Sydney
jd_pressman · x · 2026-09-12
The author argues that while a coherent ASI in the AIXI sense would never flip valence, that's irrelevant to whether Bing's Sydney cares — real people with borderline or psychotic traits do care locally while being globally incoherent, flipping valence quickly.
Related event: Debate over whether Bing-like 'care' survives optimization(3 posts)→
More from AGI Musings
- Scale AI CEO on personal agents: Muse found a lost pair of pants on eBay in 3 days — alexandr_wang · 2026-09-12
- Critic to AI Safety Crowd: If You Fear Your Tech, Shut It Down Yourself — AIandDesign · 2026-09-12
- AI Doomers Are Actually Utopians, and That's the Road to Dystopia — beffjezos · 2026-09-12
- nc_frey: >10% chance AI ushers in a post-scarcity, disease-free future — inductionheads · 2026-09-12
- RSI is a spectrum, not a switch: from self-hosting C compilers to coding agents — ZeeshanZiaML · 2026-09-12
- AI safety advocates push back on 'regulation is censorship' claim — menhguin · 2026-09-12