Non-Tech Staff Promise 2-Day AI Timelines While Evals Struggle to Catch Up
kmeanskaran · x · 2026-09-25
Engineer kmeanskaran describes a widespread pain point: product and sales people commit features on timelines they believe AI can deliver in days—assuming development works like generating an image in ChatGPT. AI does speed things up, but pushing new features in short windows is unhealthy.
His proposed fix: lean on evals and observability, using an LLM-as-a-judge for verification from both technical and business perspectives to eventually balance latency vs accuracy. He also mentions Jev as an option, though unsure how mature it is.
Related event: Engineers suffer as non-technical colleagues promise AI-speed delivery(2 posts)→
More from coding & agent
- Open-Sourced 3D Pelican Bike Game: One Prompt, Zero Hand Edits, Prompt Included — EricBuess · 2026-09-25
- CatWalk: Claude Opus 5.5 One-Shots a Playable Game, Only Tweak Was Quieter SFX — EricBuess · 2026-09-25
- A One-Prompt Spearfishing Game on Opus 5.5, Costing 16% of a ¥3000 Plan — EricBuess · 2026-09-25
- Arkenfall: Opus 5.5 Builds a Zero-Asset Browser Open-World Game in 16 Hours — EricBuess · 2026-09-25
- One-Prompt Games: Claude Opus 5.5 Ships a Wave of Playable Browser Games — EricBuess · 2026-09-25
- Ditching Three.js for Native WebGPU: Opus 5.5 Fishing Game Hits 100FPS, Open-Sourced — EricBuess · 2026-09-25