Tutorial: Turn Agent Production Traces into Regression Evals and Fixes
MarcusSchiesser · x · 2026-08-07
The author shares a weekend tutorial demonstrating how to extract a failed production agent trace and turn it into a regression eval.
Using a debugging story of a weather agent, the walkthrough illustrates a complete workflow: trace extraction -> eval creation -> agent fix. The project is open-source and built on OpenAI models and the AI SDK.
More from coding & agent
- Cerno: Open-Source Local Deep Research Agent with Observable Reasoning — tom_doerr · 2026-08-07
- 11 Setups to Run Autonomous AI Agents Overnight and Wake Up to Shipped Work — thisdudelikesAI · 2026-08-07
- Auto-Review Drains Quota: Codex Consumes 1.7 Billion Tokens — bdsqlsz · 2026-08-07
- Beijing's Haidian Opens 43.6 km² for Real Urban Planning Exclusively by AI Agents — bdsqlsz · 2026-08-07
- Neo4j Open-Sources Tool to Transform Unstructured Docs into Knowledge Graphs via LLMs — tom_doerr · 2026-08-07
- Open-Sourcing Mandate: A Financial Stack Giving AI Agents Economic Autonomy — RichardsonDx · 2026-08-07