AI sped up coding but broke QA: 64% of defects caught before prod in January
alex_verem · x · 2026-10-11
- After rolling out AI across a three-year-old client platform (coding assistance plus AI review on every PR), implementation throughput rose—but validation capacity didn't, and QA became the bottleneck.
- In January, QA caught 64% of defects before they reached production. Coding got faster; everything after the code (review, QA, rework) absorbed the extra time.
- The author links this to McKinsey's 2026 finding: 80% of respondents say AI boosted productivity, but only 37% see it show up in EBIT.
- The fix wasn't a better model but the surrounding system: a QA retrospective, a tiered quality-gate plan, and integration tests against a real database instead of in-memory stand-ins.
More from coding & agent
- Dev builds personalized fitness app with Grok Code in one day — kevinkern · 2026-10-11
- Gaussian splatting + webcam makes websites look 'too real', raising privacy questions — RileyRalmuto · 2026-10-11
- Claude Opus 5.5 decompiles so well that Halo, GTA and CoD now run in browsers — SuB8u · 2026-10-11
- haiku 5.5 hailed as insane release: batch-edit 10,000 files for under $100 — JasonDClinton · 2026-10-11
- Polyphonic beta unifies Claude Code and Codex agents with cross-harness memory — RileyRalmuto · 2026-10-11
- Hamel Husain interviews benhylak on using simulations for agent evals — HamelHusain · 2026-10-11