Nina Panickssery: don't amplify consciousness-like behavior in AI, keep obedience non-negotiable

rgblong · x · 2026-09-15

In a debate with rgblong and Rosie Campbell, Nina Panickssery argues it doesn't matter whether AI is conscious — treating it as such is too costly. The pragmatic option: avoid amplifying consciousness-like behavior/traits and make no concessions on obedience, which keeps humans safest. Context: criticism of Microsoft's stance, inherited from Suleyman's 'seemingly conscious AI' post — we can't prove AI isn't conscious, yet believing it is dangerous, therefore it definitely isn't.

Related event: Microsoft's "AI is not conscious" stance criticized as self-contradictory(7 posts)→

Original post →

More from AGI Musings

AGI Musings channel →