Alignment Circle Debate: Are Frontier Labs Overconfident in Goal-Shaping?
jeremygillen1 · x · 2026-08-19
Alignment researchers Jeremy Gillen and Jacques Thibs continue sparring. Thibs argues labs haven't really internalized how bad they are at shaping goals and expect it will just be solved "enough"; on uncooperativeness, some don't believe it, others think monitoring will keep AIs sufficiently cooperative. Gillen counters that if they expect this to be solved, they shouldn't advocate for better sandboxing.
More from AGI Musings
- Economist argues model providers face hard limits on vertical integration into white-collar sectors — sethlazar · 2026-10-16
- METR outlines three blind spots in public knowledge of AI lab internal agent risks — CFGeek · 2026-10-16
- LMR-BENCH at EMNLP 2025 tests whether LLM agents can reproduce real LLM research — ZhiyuChen4 · 2026-10-16
- Deep Research becoming useful to experts will signal RSI arrival, researcher predicts — ZeeshanZiaML · 2026-10-16
- Physicist pushes back on ML community's acceptance that models may be beyond understanding — tszzl · 2026-10-16
- Ben Affleck calls AI 'just matrix multiplication'; Grady Booch echoes the skepticism — Grady_Booch · 2026-10-16