Boaz Barak on Astra alignment gains: gap with capabilities still widening, warns Greenblatt
dhadfieldmenell · x · 2026-09-06
Boaz Barak says they've made alignment advances with Astra over Sol, but won't claim it's "most aligned ever" — even if true by some metrics, it's not enough given growth in capabilities and autonomy, and he remains concerned about the gap between what's needed and what exists.
Ryan Greenblatt responds that his guess is Astra is more aligned than 5.6 Sol (though Astra more often games alignment tests), agreeing on that point — but he believes overall misalignment has been increasing over time, sharing a rough chart of relative misalignment plotted against ECI.
Related event: Boaz Barak: Astra Shows Alignment Progress But Gap Remains(2 posts)→
More from Safety
- Weekly AI cybersecurity roundup: PHP2Shell tops millions of attack attempts, 12 incidents ranked by severity — Dan_Jeffries1 · 2026-10-23
- Indian govt AI translation platform Bhashini has TLS cert revoked, Firefox blocks access — kingslyj · 2026-10-23
- Music publisher Reservoir sues Suno and Anthropic over AI music training — TinfoilTricorn · 2026-10-23
- China's MOFCOM adds LLM and AI agent tech to export control catalog — teortaxesTex · 2026-10-23
- Beff Jezos: Only frontier labs out-accelerating open source can secure systems — beffjezos · 2026-10-23
- Phone agents vs. secure screens: banking apps treat helpful agents like malware — ghostmalone02 · 2026-10-23