Dawn Song's Team Releases Vero Benchmark for AI-Generated Formally Verified Software
dawnsongtweets · x · 2026-08-23
Researchers from UC Berkeley and collaborators released Vero, the first benchmark to evaluate AI agents on joint implementation and proof synthesis at the repository level. Vero includes 43 real-world multi-module instances across domains like cryptography and distributed systems. It features a formal audit mechanism where agents can submit machine-checked proofs to verify specifications or identify errors in reference implementations.
More from coding & agent
- Non-tech clients burned by using Claude as runtime layer — DuaneJRich · 2026-08-23
- NVIDIA details agentic inference economics: Claude Code hits 85-97% cache, 11.7x read/write ratio — _ScottCondron · 2026-08-23
- Developer achieves 100% autonomous news site workflow — MicahBerkley · 2026-08-23
- Agent-Aware Infra: Optimizing Inference via Cache and Scheduling — _ScottCondron · 2026-08-23
- Dev Endorses k3 + NousResearch Harness as Best Combo — markjeffrey · 2026-08-23
- go-codex-proxy: Bridge Multiple APIs to Codex Workflow — Al_Grigor · 2026-08-23