Astra finds bug in Anthropic's formal verification example: spec doesn't check output matches input
teortaxesTex · x · 2026-10-24
- Astra discovered a bug in Anthropic's own formal verification example: the "specification" fails to actually check that output bytes match input bytes.
- The author highlights the irony of a demo for formal verification missing the key property it was meant to verify.
More from Models
- Terminal-Bench exposes NVIDIA Nemotron 3.5 near-zero score vs Kimi K3.1's 65.7% — JJitsev · 2026-10-24
- Bench shows GPT-5.6/6 Luna crush multi-agent coordination while DeepSeek V4 fails — JoshPurtell · 2026-10-24
- Grok Bot adds secure vault so agents can log in and pay without seeing your secrets — XFreeze · 2026-10-24
- Kimi K3.1 Pro reportedly first Chinese model to solve 20x20 nonograms — fairydreaming · 2026-10-24
- Kimi K3.1 vs GPT-6 Astra head-to-head on an identical agentic 3D task — GapNew4766 · 2026-10-24
- Kimi K3.1 Pro Launches: Scores 55 on Artificial Analysis, Open Weights Promised by Nov 2026 — Simon Willison · 2026-10-24