SWE-bench co-creator designs Stanford CS329Z HW2 on Terminal-Bench-style agent evals

FinanceYF5 · x · 2026-11-16

CS329Z Assignment 2 focuses on agent evaluation, designed by SWE-bench co-creator and course instructor John Yang. Built on the Harbor framework, it teaches students to build Terminal-Bench-style evals that reflect real tasks — judging not just whether agents finish tasks but how well. The course is also supported by Laude Institute, Thinking Machines, Google Cloud, AWS and Harbor Framework, which provide students API credits to run and evaluate agents hands-on.

Original post →

More from coding & agent

coding & agent channel →