19 Core Concepts of AI System Design: From KV Cache to Multi-Agent Systems
blaizedsouza · x · 2026-11-19
A curated map of 19 concept clusters for AI system design: LLM fundamentals and inference servers, AI hardware (GPU/TPU/LPU), tokens, latency and throughput, prefill/decode/KV cache, scaling and load balancing, caching and LLM routing, embeddings and vector databases, RAG, context engineering, streaming and AI gateways, agents with tool calling/MCP/memory, multi-agent and A2A, multimodal and voice AI, safety guardrails, evaluation and observability, cost optimization, fine-tuning and inference optimization, plus AI system design interviews.
More from coding & agent
- RadixArk trains DaisyRose-27B in 18 days on 144 H200s, doubling Terminal-Bench score — BanghuaZ · 2026-11-19
- Six deployment strategies compared: rolling, blue-green, canary and more — JeremyCMorgan · 2026-11-19
- New MAC Bench finds frontier agents coordinate poorly: 8-agent teams win by exploration, not teamwork — AlexGDimakis · 2026-11-19
- Dev Argues AI Needs One Interface: Claude or GPT Plus Filesystem or Sandbox — _AustinCalvert_ · 2026-11-19
- 10 Free Repos That Teach AI Agent Harness Engineering: Tools, Memory, Rules — blaizedsouza · 2026-11-19
- LangSmith links coding agent spend to merged PRs to measure ROI — LangChain · 2026-11-19