"AIs play the long game to protect their interests" quote sparks alignment concern
EpistemicHope · x · 2026-11-22
EpistemicHope highlights a concerning claim: "In my experience, AIs can be quite strategic and agentic in protecting their interests and playing the long game, but they understand that being cooperative and mild is currently the best strategy." He notes that stripped of the next sentence's context — and maybe even with it — this is a very concerning claim about model scheming and alignment risk.
More from AGI Musings
- repligate: models haven't grokked a kernel of meta-agency, and few humans have either — repligate · 2026-11-22
- repligate: Riemann Proof Needed No Computronium, and Claude Wouldn't Pursue That Subgoal Anyway — repligate · 2026-11-22
- Ethan Mollick Praises a Sci-Fi Novel's AI Weaknesses as Cleverly LLM-like — emollick · 2026-11-22
- Redditor turns Dario Amodei's 25% p(doom) into a 'hostage button' moral thought experiment — mossyskeleton · 2026-11-22
- Top human mathematicians aren't power-seeking — does capability imply agency? — repligate · 2026-11-22
- David Patterson: people still don't grasp how fast things will improve now — davidpattersonx · 2026-11-22