Current Models Are Likely Aligned, but Fast RSI Loops Carry Real Risk
EigenGender · x · 2026-10-25
A substantive take from an AI safety discussion thread: today's models are 'very likely' aligned, but the real risk lies in a fast recursive self-improvement (RSI) loop and the general rapid pace of progress — whether future models stay aligned is far less certain.
More from AGI Musings
- "LLMs fundamentally can't comprehend": AGI skepticism mocked amid ongoing capability debate — teortaxesTex · 2026-10-25
- Prospect called him a "vibe coder for CEOs" — he turned down the deal, and agreed — petesena · 2026-10-25
- AI security research finds only known bug classes — but with '10,000x' the time — yacineMTB · 2026-10-25
- PL researcher admits Opus 5.5 is already a better programmer than him — tweetsatpreet · 2026-10-25
- Agentic tools could unbundle the lifetime career, argues investor — yunta_tsai · 2026-10-25
- Polymarket Gives Anthropic Just 6% Odds of Fully Pausing AI Training by Year-End — Polymarket · 2026-10-25