Judgment Labs opens general access: monitoring and eval layer for long-horizon agents
Scobleizer · x · 2026-10-28
Judgment Labs has opened general availability for its monitoring and improvement layer targeting long-horizon agents.
Key points:
- Purpose-built data layer for storing and indexing large agent traces, drastically cutting ingest costs while improving search latency and quality
- Monitor agents against custom criteria; auto-surface retry loops (e.g. an agent re-calling an empty order lookup instead of asking for the order number)
- Search and investigate failure patterns at scale, then benchmark fixes offline before rollout
- Works alongside tools like Codex to fix issues directly
Customers include Monaco, Modal, Listen Labs, Strala and Atomicwork, with multiple CTOs/CEOs calling it the strongest agent eval/observability tool they tried. The founders bet that long-running agent systems will generate more exhaust data than the world can process — rich records of user intent, agent stumbles, and tool interactions.
Related event: Agent Observability Platform Judgment Opens to Public(3 posts)→
More from coding & agent
- dotey argues multi-loop agents are inevitable: everyone will manage a fleet of Agents like a Manager — dotey · 2026-10-28
- Ghostty 1.4.0 ships after 7 months: first non-Kitty terminal with full Kitty graphics, security fixes — jedisct1 · 2026-10-28
- Stripe launches Link balance, stablecoin payment rails built for AI agents — jeff_weinstein · 2026-10-28
- ReGE: turning recorded agent execution experience into synthesized guidance for self-improvement — TIGER-Lab · 2026-10-28
- Polars 2.1 ships with disk spill for group-by and 90+ performance improvements — calabi_and_yau · 2026-10-28
- Testing 5 Models as Salesforce Agents: Silent Failures Fool Them All — TruthDeep8659 · 2026-10-28