Skeptic: OpenAI can't formalize 'this AI won't murder you' in Lean

zetalyrae · x · 2026-11-17

User @RatOrthodox argues OpenAI will not be able to formalize a guarantee like "this AI will not murder you" in Lean. Any attempt, they claim, would run into the same problems GOFAI-era alignment researchers discussed in the late 1990s: behavioral and moral guarantees resist formalization as checkable mathematical proofs.

A concise entry in the ongoing debate over whether formal methods can ever verify frontier model safety.

Related event: Skeptics Question OpenAI's Formal AI Safety Plans(3 posts)→

Original post →

More from AGI Musings

AGI Musings channel →