Sentry CEO asks: how do you write integration tests for agents?
zeeg · x · 2026-11-23
Sentry CEO David Cramer asks agent builders how they approach integration tests: Sentry calls the real model and VCR-records it, but reliability remains shaky; mocking fixtures instead requires an eval suite that "will almost certainly continuously degrade." He calls it seemingly unwinnable and is soliciting community experience.
More from coding & agent
- The hard part of AI coding: knowing which old best practices are now antipatterns — DavidWells · 2026-11-23
- New Developer Superpower: Learn Architecture Patterns and Steer the AI — DavidWells · 2026-11-23
- orgchat: open-source E2E-encrypted MCP relay lets Claude Code, Codex and Cursor agents talk to each other — Nice-Enthusiasm8191 · 2026-11-23
- Long Wind: a browser wuxia action game fully coded by Claude Opus 5.5 in one day — Promptmethus · 2026-11-23
- Dev ships arcade football game with Claude Code: 100 plan files, Sonnet builders, Opus reviewers — danielknugs · 2026-11-23
- Managing Tailscale with Alchemy: IaC stacks in TypeScript with Effect — samgoodwin89 · 2026-11-23