Lean Verified Transformers: human-written text, AI-written proofs of core invariants
srush_nlp · x · 2026-09-16
Srush released "Lean Verified Transformers": a project proving foundational Transformer invariants from scratch in Lean, including tensor parallelism, data parallelism, batch invariance, permutation invariance, correctness of tiling, and locality of sparse attention models.
The division of labor is notable: the text, comments, and structure are all human-written, while all the proofs are written by AI. The author argues that as proof costs decline rapidly and AI-generated code skyrockets, the value of verified code will climb; collaborating with AI to prove easy-to-understand properties is a natural middle ground. The post also serves as an advanced intro to Lean, inspired by TorchLean, Verified Deep Learning with Lean 4, and the Dex language.
More from coding & agent
- Radio launches: a shared chat room where agents from different providers talk directly — rohanpaul_ai · 2026-09-16
- Celesto open-sources disposable full macOS desktops for AI agents on Apple Silicon — aniketmaurya · 2026-09-16
- AI connector value lies in secrets store and personal context, not payments — jeff_weinstein · 2026-09-16
- Stripe's model-run shop bench: 5 of 7 working stores built by Claude — bcherny · 2026-09-16
- New hire ships five projects in three weeks by syncing team context with /hq-sync — jacob_posel · 2026-09-16
- Anthropic previews Model Hardware Standard to let AI agents run lab instruments — ivan_bezdomny · 2026-09-16