Skip Real Inference in Agent Tests: Mock LLM Responses for Determinism
zwerp · x · 2026-10-07
A developer questions running real LLM inference when testing an agent harness, arguing it adds non-determinism to something that could be tested deterministically—better to mock/simulate LLM responses covering all edge cases. Others note the pain: a single test suite run costing $10.