Meta Data: AI-Reviewed Diffs Have 1/50th the Production-Incident Rate of Human Review
arjunrajlab · x · 2026-10-08
An insider shares actual data on AI vs. human code review from inside Meta:
- Engineers now push 3x the code they did a year ago; human review capacity didn't triple
- Across an analysis of 535k+ reviewed diffs, the production-incident rate for AI-reviewed diffs was 1/50th that of human-reviewed ones
- Revert rate for AI-reviewed diffs was 1/3 of human-reviewed
- Median review wall time dropped 35%
- Experts examined every production incident from AI-approved diffs—no human reviewer would have caught those issues in manual review either
- Meta's internal coding agent lands 3,000 diffs a week, with 59% needing zero human edits
The author's conclusion: human review as the default for most code changes is already obsolete, and might even be riskier. Source linked in the original thread.
More from coding & agent
- Dev amazed as AI sets up a fresh computer's config in seconds, not minutes — Dimillian · 2026-10-08
- After a $10,811 Cloudflare bill, dev ditches delayed billing alerts for a Grok-built 3-hour usage monitor — mazzaTalk · 2026-10-08
- Voice agents that call businesses for people: caller ID, disclosure, billing and other pitfalls — Born-Mastodon443 · 2026-10-08
- Harvard study of 718 firms finds AI coding boosts individual output ~30% but firm-level shipping doesn't move — DavidLinthicum · 2026-10-08
- Dimillian shares a 4-step Codex workflow for native-looking iOS apps — Dimillian · 2026-10-08
- WSJ columnist declares 'the year of Linux' is finally here, thanks to AI agents — alexvoica · 2026-10-08