Debate: can OpenAI's plan to have agents formally prove safety properties work?

zetalyrae · x · 2026-11-17

@bicellaria questions whether OpenAI's "The Plan" is to have agents formally prove safety properties despite nobody knowing which theorems need proving — arguing such a plan predictably won't work.

@tszzl counters that this is confused thinking: you can automate safety research while still verifying results, so human oversight isn't handed off; formal verification powers will only grow as we understand these systems better. zetalyrae amplifies the exchange, spotlighting the core dispute over formal methods as an AI-safety anchor.

Original post →

More from AGI Musings

AGI Musings channel →