TLAPS-Bench: agentic AI formal verification uncovers read consistency bug in SlateDB's WAL

tianyin_xu · x · 2026-11-07

A new paper introduces TLAPS-Bench, a benchmark and execution harness for constructing machine-checked proofs of real-world system specifications in TLA+ using agentic AI.

Immediate payoff: the author's TLA+ specification of SlateDB's WAL protocol revealed a read consistency bug — one SlateDB likely shares (extremely unlikely to trigger, still needs confirmation). The culprit is once again GC complicating put-if-absent; a simple fix has been validated.

Notably, the author's own model checking with 3 competing writers never caught the violation, while TLAPS-Bench with Astra Max found it at 4 competing writers — a strong showcase for agentic-AI-driven formal verification of distributed systems.

Original post →

More from coding & agent

coding & agent channel →