"If the agent does the verification, you have a junkyard": software factories need external verification
blaizedsouza · x · 2026-09-21
Dominik Tornow challenges current thinking on "software factories":
- Ideal definition: a software factory produces software end-to-end—humans supply a specification, the factory delivers a verified-correct implementation.
- Core claim: correctness does not come from orchestration—better workflows, skills, instructions, or more agents checking agents will not work, because "a heuristic cannot certify the result of a heuristic".
- Key line: if the agent does the verification, "you don't have a factory. You have a junkyard."
The argument highlights a missing piece in agent coding workflows: verification independent of LLM heuristics.
More from coding & agent
- Ora's Ranker 3.0 grades whether agents can actually use your site; scores drop 40+ points — yenkel · 2026-11-12
- Gemini API Managed Agents now support self-hosted sandboxes, incl. Vercel — steren · 2026-11-12
- Rayline launches ARC, a per-turn model router claiming 90% cost cuts — testingcatalog · 2026-11-12
- Karpathy's llm-wiki: a pattern for building personal knowledge bases with LLM agents — stochasticchasm · 2026-11-12
- Agent self-improvement with frozen weights: failure traces add just 4pp, blind search gets 60% — burny_tech · 2026-11-12
- Microsoft on agentic schedulers: LLM proposes, deterministic code validates — WirelessLife · 2026-11-12