An agent stack diagram says production AI is 90% architecture, not prompts
theomitsa · x · 2026-07-23
A shared diagram argues that production AI is mostly systems engineering, not just prompt writing or model choice.
It contrasts a toy pipeline:
- Prompt → Model → Tool → Response
with a production stack built from:
- Model
- Context
- Memory
- Tools
- Skills
- Orchestration
- Identity
- Policy & guardrails
- Observability
- Evaluation
- Runtime
The central thesis is that the model may be only 10% of the agent architecture, while the remaining 90% decides whether the system survives in production. The chart also lists what breaks when each layer is missing, plus best practices such as using the smallest reliable model, making plans observable, automating evals, and designing for graceful degradation.
Related event: AI Agent Engineering Shifts to Layers and Loops(5 posts)→
More from coding & agent
- Chaining dependent MCP tool calls: no rollback, duplicate risk — agentrsdg · 2026-09-11
- DeepMind-led paper makes design docs the source of truth, code disposable — SMART regenerates in 1.5-3h for ~$100 — Roger_M_Taylor · 2026-09-11
- Agent-built classifier labels 192k docs for $0.70 vs $13-26 with frontier LLMs — vanstriendaniel · 2026-09-11
- MathModelAgent gains traction: auto-solves math modeling and writes a submission-ready paper — jihe520 · 2026-09-11
- alphaXiv open-sources OpenResearch to run parallel research agents with any model — alphaXiv · 2026-09-11
- DeskcommCRM: open-source AI sales CRM with native agents and WhatsApp hits 1k stars — melgarafael · 2026-09-11