Noam Brown clarifies clip: isolated agents can coordinate with just a few bits
jachiam0 · x · 2026-09-19
Noam Brown responds to clipped excerpts of his Dwarkesh Patel interview: the discussed example was academic, meant to show that absolute isolation guarantees are hard. The point isn't weight exfiltration via temperature sensors but coordination between supposedly isolated agents, which can require only a few bits of information. Lessons from the HF incident: over-reliance on sandbox isolation, too few independent safeguards; airgapping remains extremely strong. The full episode also covers multi-agent, math progress and recursive self-improvement, and how to know if models are aligned before RSI.
More from AGI Musings
- Economists Ben Moll and Alex Imas: don't expect double-digit GDP growth from AI within 10-15 years — binarybits · 2026-09-19
- AI Growth Bet: Per-Capita GDP Growing 15% Above Peak Has Just 0.9% Historical Odds — RishiBommasani · 2026-09-19
- AI Makes Old Expertise Cheap—and Creates More Expert Work Finishing What It Starts — every · 2026-09-19
- "Think AI Safety Is Bad? Wait Until the Public Writes AI Policy" — NathanpmYoung · 2026-09-19
- Many New Projects Are Being Built on Chinese Open-Weight Models — signulll · 2026-09-19
- Ethan Mollick: The "Capability Overhang" — AI Can Do Far More Than Anyone Uses It For — One Useful Thing (Ethan Mollick) · 2026-09-19