Formally verifying the Claude Agent SDK with Lean yields 16 bug-fix PRs from a few prompts
dyn___ · x · 2026-09-24
@bcherny describes using Claude (Opus) with the Lean theorem prover to formally verify the Claude Agent SDK: a couple of short prompts produced 16 PRs fixing bugs and race conditions.
He notes TLA+ works well too, and he often combines Lean and TLA+ to probe data flow, concurrency, and state management issues — despite not knowing either language deeply. He also cautions that without language expertise, a safer claim is 'somewhere between better than me and probably decent — building an eval.'
More from coding & agent
- Dev builds bot that turns every X mention of Linear into structured product feedback — soleio · 2026-09-24
- Sila, a YC-backed agent messaging platform, reports 500K messages and 70% day-7 retention — ycombinator · 2026-09-24
- He stopped reading code: 13 parallel AI agents caught a critical bug humans missed — every · 2026-09-24
- 26 Opus 5.5 agents built a multiplayer game overnight on a custom LLM-native game engine — mattshumer_ · 2026-09-24
- Formally verifying the Claude Agent SDK with Opus 5.5 and Lean yielded 16 bug-fix PRs — spikedoanz · 2026-09-24
- PlayCanvas Engine can now run headlessly in Node.js without JSDOM — here's how — willeastcott · 2026-09-24