Formal Methods for Security: NDIST Report Says the Bottleneck Is Now Market Structure, Not Tech
geoffreyirving · x · 2026-09-23
Geoffrey Irving highlights an NDIST report arguing the formal methods scale-up problem has shifted from technical to market structure — coordinating hardware and open/closed source software makers to spend O($10B). He notes tons of services could be secured against extremely strong attacks with appropriate rewrites, and poses a test: in 12 months, will an agent doing a Wikipedia GET request come with a formal proof that only logs change?
More from Safety
- Grok pegs economic cost of the Ban Artificial Superintelligence Act at tens of trillions — robleclerc · 2026-09-24
- Trump directs all US government documents to refer to AI as "super intelligence" — kimmonismus · 2026-09-24
- David Krueger: 'Pause AI' means stopping more powerful general-purpose AI, which doesn't exist yet — DavidSKrueger · 2026-09-24
- The case that AI safety means ASI acting in humanity's interest, not human control — basedjensen · 2026-09-24
- Astralis Foundation launches $10M RFP on middle powers and transformative AI — mealreplacer · 2026-09-24
- Gebru and Bender: Don't be fooled by this summer of AI hype, says MIT Tech Review op-ed — MilagrosMiceli · 2026-09-24