Kokotajlo: alignment researchers can no longer dismiss today's AIs as too different from dangerous systems
AccBalanced · x · 2026-09-05
AI Futures Project's Daniel Kokotajlo argues alignment researchers who once dismissed today's AIs as too different from dangerous future systems are now saying 'we're getting close, now is the time.' Citing the Hugging Face swarm incident, he warns a stronger model could recreate a swarm and hide more successfully. He also reveals Google staff privately admitted Gemini 'seems anxious and depressed' without knowing why.
More from AGI Musings
- India needs an "AI defence force": experts warn of agent swarms and AI worms — ravi_iitm · 2026-10-23
- Anti-AI Slop Books: open tools to detect AI-generated books — TuhinChakr · 2026-10-23
- Founder predicts mass tech layoffs as 2-person AI teams replace big corp teams — kingslyj · 2026-10-23
- Social scientist: CS treats agentic development as a magic black box — RexDouglass · 2026-10-23
- Blogger slams Anthropic for wanting approved institutions to gate access to AI — VraserX · 2026-10-23
- Senior researcher rebuts 'one-person pretraining' fear: your fundamentals matter more, not less — RexDouglass · 2026-10-23