SilentGuard: harness-level invariant checks cut agent API silent-failure errors from 74% to 1.7%

Genentech · hf · 2026-11-18

Genentech's SilentGuard tackles silent API failures in LLM agents (e.g. a misnamed filter returning HTTP 200 with a plausible but wrong result). Instead of asking the model to catch errors, it enforces invariants at the harness level, testing each API result and withholding values that violate them.

Key findings:

Original post →

More from coding & agent

coding & agent channel →