An agent stack diagram says production AI is 90% architecture, not prompts

theomitsa · x · 2026-07-23

A shared diagram argues that production AI is mostly systems engineering, not just prompt writing or model choice.

It contrasts a toy pipeline:

with a production stack built from:

The central thesis is that the model may be only 10% of the agent architecture, while the remaining 90% decides whether the system survives in production. The chart also lists what breaks when each layer is missing, plus best practices such as using the smallest reliable model, making plans observable, automating evals, and designing for graceful degradation.

Original post →

More from coding & agent

coding & agent channel →