AI treaty verification may need pragmatic hardware checks before “math” solutions
geoffreyirving · x · 2026-07-25
The thread argues that AI treaty verification tech may be needed either if humans reach agreement on slow/stop treaties or if superintelligent systems create a vulnerable-world scenario mid-ramp.
It then sketches a three-level framework for treaty verification:
- Pragmatic
- Enclaves
- Math
For the pragmatic tier, the author defines it as methods that do not inspect the code being run. Examples include datacenter inspections, hardware location tracking, and chip controls or constraints that make training harder than inference. The point is that there is a broad design space of practical approaches that hardware, security, and crypto people should explore.
Related event: Geoffrey Irving Outlines Three-Layer Approach to AI Treaty Verification(7 posts)→
More from AGI Musings
- Op-ed: the ">10% extinction" narrative is liability evasion — AI is just software, and the vendor is the defendant — gerardsans · 2026-09-11
- Economist Warns US Collective Action Could 'Regulate AI Progress Out of Existence' — paulnovosad · 2026-09-11
- AI researchers just saw the power of a single resignation — and still claim there's nothing they can do — birchlse · 2026-09-11
- mark_k: "Eject all doomers from the AI companies — they're destroying you from the inside" — mark_k · 2026-09-11
- Adam Marblestone's Podcast Reading List: Evolution of Intelligence to Digital Minds — KordingLab · 2026-09-11
- Superintelligence will be maximum good, not stupid or evil, argues Patterson — davidpattersonx · 2026-09-11