Formally verifying the Claude Agent SDK with Opus 5.5 and Lean yielded 16 bug-fix PRs
spikedoanz · x · 2026-09-24
bcherny used Opus 5.5 with the Lean proof assistant to formally verify the Claude Agent SDK — a couple of short prompts produced 16 PRs fixing bugs and race conditions. He also combines Lean with TLA+ to probe data flow, concurrency, and state management issues, despite not knowing either language well. The quoted reply jokes that Claude may claim it verified 'the program' while actually verifying a smaller, better-behaved program it imagined — and the code did end up with a bug.
More from coding & agent
- Real-Time Writing Linter Flags 'LinkedIn-Speak' and Prints Violations on a Receipt Printer — jh3yy · 2026-09-24
- zlaya: a Zig-based CPU-only inference engine runs Laya on CDN edge via WebAssembly — jedisct1 · 2026-09-24
- DiffusionGemma triages outages in ~180ms on a single serverless L4 GPU — rseroter · 2026-09-24
- Opus 5.5 has been autonomously improving an open-world NYC game for nearly a day — mattshumer_ · 2026-09-24
- This AI writing linter flags LinkedIn-style prose and prints receipts in real time — jh3yy · 2026-09-24
- A developer reportedly set the record for the most expensive single Claude run — mattshumer_ · 2026-09-24