Productionizing AI Apps: OpenTelemetry, On-Call Agents, and Full Observability Workflow
Al_Grigor · x · 2026-08-21
This post covers the fourth workshop of AI Dev Tools Zoomcamp, focusing on making an AI-built application production-ready. Using a system design interview app from a previous session, the author demonstrates a complete DevOps and observability workflow:
- Environment Separation: Isolating dev and prod to prevent bad changes from reaching users directly.
- Instrumentation: Implementing OpenTelemetry for traces, metrics, and logs.
- Stack Deployment: Deploying an OTLP collector with Prometheus, Loki, Tempo, and Grafana.
- Visualization & Alerting: Building a Grafana panel for error rates linked to traces and setting up a Prometheus alert.
- Automated Remediation: Creating an "on-call agent" that polls alerts, investigates the observability stack with read access, and can push fixes.
This provides an end-to-end reference workflow from code to monitoring to autonomous remediation.
More from coding & agent
- AI Agent Catches Vendor Contradictions by Cross-Referencing Proposals — nordic_ash · 2026-08-21
- Indie dev plans 'speaking training tool' using viral MediaCrawler scraper — yihui_indie · 2026-08-21
- Self-Hosted Read-Only MCP Server for Secure Email Access — ivan-capk-me · 2026-08-21
- Pydantic AI v2.32.2 released with realtime session and evals fixes — samuelcolvin · 2026-08-21
- Developer creates script to shorten verbose AI coding responses — victor_explore · 2026-08-21
- Wake: macOS app unifies chat history for 13 code agents — aigclink · 2026-08-21