Sep 12 Workshop: Engineering production-ready agents with rigorous evals and CI regression suites
camerongreen95 · reddit · 2026-09-01
A hands-on masterclass on Sep 12 focuses on building agents and LLM systems with real engineering discipline. Key topics include treating prompts as versioned code with regression tests, implementing a real eval harness with deterministic checks and LLM-as-judge scoring, and using bootstrap confidence intervals for model comparison. The workshop also covers evaluated RAG with proper metrics, tool-using agents with guardrails and retries, and full production observability including cost/latency tracking and CI integration.
More from coding & agent
- Building a Private AI OS on 4x RTX 2080 Ti — askincihan · 2026-09-01
- Llama Mac app adds REST API request builder for llama.cpp — ggerganov · 2026-09-01
- Prototyping Tennis Game Level with Grok 4.6, Unity, and Blender — chongdashu · 2026-09-01
- Multi-Agent Memory Architecture: Targeted Retrieval vs. Unified Store — Fun-Following-1723 · 2026-09-01
- Vapi SDK Silent Failure: start() Resolves on Mic Block — skywave84 · 2026-09-01
- Solving Agent Detection and Memory Loss: Real Browser and Local Storage Solutions — Spliff_77 · 2026-09-01