Survey: 69% of production model swaps took weeks of engineering work
ombre-ai · reddit · 2026-11-13
A VentureBeat Intelligence survey (VB Pulse, Oct 2026) of AI practitioners at 100+ employee companies found 47% had swapped the model in a production AI system in the past 12 months while keeping the app intact.
Among 45 respondents who actually did a swap:
- 69% needed weeks or more of engineering work
- 36% took over a month
- Only 13% said it was nearly a configuration change
Outcomes: 56% said the new model performed as well or better, 33% reworked the app after performance dropped, and 11% rolled back. The author notes the small sample and vague time buckets; interviews with Box, PayPal and Uber point to prompts, tools, harness and fine-tuning tied to the old model as the slow part.
More from coding & agent
- Indie dev's AI coding bill hit ~$4,000 building MailCheap, making it his first unprofitable product — marclou · 2026-11-13
- Sketchy Update: Claude Now Sketches Molecules and Circuits, Open Source — Nkgsporty · 2026-11-13
- Descope's Envoy gives AI agents their own sign-in identities, compatible with Poppy — AiBreakfast · 2026-11-13
- CMU trains LLMs to write memories with RL for continual learning across task streams — aviral_kumar2 · 2026-11-13
- One Prompt + Claude Code Produces a 5-Minute 3D Explainer Video — Western-Airline9355 · 2026-11-13
- Network vet of 30 years builds monitoring tool with Claude Code in 2 days for $10 — Greedy-Giraffe-4269 · 2026-11-13