Stanford CS329Z Assignments: Build a QA Agent, Then Design Its Eval Suite
jyangballin · x · 2026-09-05
Developer @codehiyouga recommends Stanford's new CS329Z: Engineering AI Agents course as a checklist for anyone who already calls models, connects tools, and builds agents — especially if your system keeps gaining features but you can't tell whether each change actually helps.
The course covers RAG, tool use, MCP, agent frameworks, memory, multi-agent systems, optimization, agent data, evaluation, plus safety and reliability of long-running agents.
The assignments are concrete: build a research-paper QA agent from scratch, then design an evaluation suite with benchmark tasks, code-based graders, an LLM-as-judge, and error analysis.
Related event: Stanford launches CS329Z on engineering AI agents(2 posts)→
More from coding & agent
- Microsoft's FrontierTour: AI governance becomes everyone's problem as agents take action — donasarkar · 2026-10-23
- Grady Booch revives Weinberg's 1971 quip: software so buggy one woodpecker could destroy civilization — Grady_Booch · 2026-10-23
- One Agent Replaces Half an SDR Team: Full Lead-Research-to-Email Workflow — tibo_maker · 2026-10-23
- Why don't coding agent harnesses ship with their own sandbox? Only amp does — Aryvyo · 2026-10-23
- Dev builds a VST synth with Codex and MCP, lets the AI jam in his studio — Yamapama · 2026-10-23
- AgentsInTheCloud update: use your Claude subscription with built-in coding agents — lucasmeijer · 2026-10-23