DeepLearning.AI launches course on evaluating agentic applications with Arize AI
DeepLearningAI · x · 2026-11-05
DeepLearning.AI partnered with Arize AI to launch Evaluating and Improving Agentic Applications, taught by Laurie Voss (npm co-founder, Arize Head of DevRel).
Key premise: one successful run doesn't make an agent reliable—traditional tests confirm code works, while evals measure agent decisions against a clear definition of good behavior.
- Error analysis & test sets: read traces, label recurring failures, turn them into reusable test sets
- Trustworthy evaluators: automate with code-based checks and LLM judges
- Evaluation-driven improvement: verify every change improves the agent without regressions
Includes 28 video lessons, 6 code examples, 10 graded assignments; hands-on labs build an evaluation suite with Arize Phoenix and open-source tracing tools.
Related event: DeepLearning.AI and Arize Launch Free Course on Agent Evaluation(2 posts)→
More from coding & agent
- SammHo: one product brief feeds launch, changelog, marketing, and support content — SammHo · 2026-11-05
- Ex-Google PM to teach free 30-min lesson on building GTM agents from Linear context — SammHo · 2026-11-05
- SammHo: attach a skeleton product brief to a Linear ticket as agent context — SammHo · 2026-11-05
- Nous Research unifies Hermes Agent plugins into one marketplace with 976 plugins — NousResearch · 2026-11-05
- lookfirst adds human-in-the-loop approvals and tamper-evident audit logs to MCP agents — Ambitious_Answer6857 · 2026-11-05
- awwwards-mcp v1.18 adds a recreate skill to rebuild any page from URL evidence — _insane7 · 2026-11-05