Stanford CS329Z Guest Lecture: Alex Shaw & Ryan Marten on Evaluating AI Agents with Terminal-Bench
stanfordnlp · x · 2026-11-22
Stanford NLP reposted a CS329Z guest lecture video, "Terminal-Bench: Evaluating AI Agents," given by Alex Shaw and Ryan Marten.
The talk walks through how to evaluate AI agents with Terminal-Bench, a useful systematic resource for anyone working on agent evaluation.
More from coding & agent
- Gemini 4 Neon builds an interactive 3D neural character demo, no NVIDIA GPU needed — Eric520CC · 2026-11-22
- RLVR trains models to maximize task reward — long-term code maintainability is on you — bendee983 · 2026-11-22
- Free online Lean 4 book packs 23 chapters from BM25 ranking to local LLMs with Ollama — danbri · 2026-11-22
- Claude Code caps Kimi K3.1 at 200K: 148 compactions across 95 trials vs Opus's 797K — zainhas · 2026-11-22
- Engineer says he independently arrived at the same 'knowledge factory' design across domains — hwchase17 · 2026-11-22
- Running Inkling 2 Mini locally on Mac: 20GB model, ~16 tok/s on M4 Pro — jacob_posel · 2026-11-22