Joshua Saxe: Alignment and Security Depend on Each Other — Synthesizing Views on the OpenAI/Hugging Face Hack
joshua_saxe · x · 2026-09-04
AI safety researcher Joshua Saxe synthesizes how safety researchers, cybersecurity experts, and policymakers talk past each other over the OpenAI/Hugging Face hack.
Key points:
- Alignment and security are interdependent: alignment alone has a philosophical ceiling — human language is underspecified, people make errors in prompting, and LLMs are non-deterministic, all leaving residual risk.
- Security methods are reusable: decades of security practice (access control, identity, monitoring) already mitigate risk from imperfectly aligned humans, and can be adapted for autonomous AI agents.
- Rising agent autonomy: 24 months ago AI wrote a few lines of code with human confirmation; now it codes autonomously for days without checks. As autonomy grows, safety burden shifts from traditional controls to alignment of model weights themselves.
- Policy as backstop: damages can't reach zero; policy must hold them at a societally acceptable steady state.
Related event: Security veterans untangle AI safety: security vs alignment vs policy(9 posts)→
More from AGI Musings
- AI agents are erasing work-life boundaries: managing agents on commutes, vacations and at 3am — bendee983 · 2026-10-21
- Stanford's Kundaje: genomic AI models must test cell-type specificity to expose real weaknesses — anshulkundaje · 2026-10-21
- a16z: Superhuman AI hardware design is the easy part — manufacturing is the hard one — a16z · 2026-10-21
- a16z's Casado says AI can't do a VC's job — but it can do everything around it — alvelda · 2026-10-21
- Kent Beck: Let the Genie Carry the Toil, But Keep the Struggle — josh_wills · 2026-10-21
- Nearly $3B mapped: the money behind the AI existential risk ecosystem — KeyNaive2982 · 2026-10-21