Read-only MCP server lets Claude Code write regression tests for agents
tom_mathews · reddit · 2026-11-15
Attest's MCP server gives coding agents six read-only, offline tools to write regression tests for LLM agents: trace checking, contract drafting (e.g. "issuerefund at most once per orderid") with generated Python/TS test lines, contract execution, assertion evaluation, and failure explanation. No code execution — contracts use a closed grammar; stdio only. In the demo, a fresh Claude Code session drafted a cardinality contract, iterated until it passed on the fixed agent's recording and failed on the incident recording, then wrote the pytest test — all transcripts committed. Open question: is the closed grammar too limiting vs. letting agents write test code directly?
More from coding & agent
- The T.R.U.S.T. check: deciding which jobs you can safely hand to your AI bots — bfrench · 2026-11-15
- Bot audit experiment: triage plus deep-read cuts input 64% while staying stable — bfrench · 2026-11-15
- How do you track all the AI agents running inside your company? — CupRare814 · 2026-11-15
- Developer builds VR island adventure game with Claude Code writing the C# — Illustrious-Lynx3673 · 2026-11-15
- Attest: record agent runs once, replay in CI with zero model calls — tom_mathews · 2026-11-15
- Building a workspace where agents, not humans, are the primary users — Pristine-Student4702 · 2026-11-15