NVIDIA's Mid-Harness: a strong verifier boosts terminal agent Pass@1 from 50% to 68% on TerminalBench-Lite
rohanpaul_ai · x · 2026-10-02
NVIDIA's new paper introduces Mid-Harness, which samples and verifies candidate actions at the model-harness boundary before execution, leaving generator and harness unchanged. With a TMAX-9B generator, a GPT-5.6 Sol verifier raises Pass@1 on TerminalBench-Lite from 50.00% to 68.03% using 8 sampled actions; weak verifiers gain little from more sampling. Pairwise verification works best for self-verification, and distilling the stronger verifier's responses back into TMAX-9B further improves Pass@1.
Related event: NVIDIA Paper: Adding a Verifier Lifts Terminal Agent Success to 68%(3 posts)→
More from coding & agent
- shadcn boosts @uisdk: one-shot UI rebuild that's instantly E2E-testable by AI — shadcn · 2026-11-16
- AI agent deletes 43,599 lines of OpenClaw test code in one PR — vincent_koc · 2026-11-16
- JPMorgan shows Jarvis, its internal agent assembly line, at Interrupt NYC — LangChain · 2026-11-16
- Dev clarifies: Apple doesn't ban feature flags, only fooling App Review — talkaboutdesign · 2026-11-16
- Antigravity Matches Claude Cowork in Tests, While Gemini Tasks' Purpose Remains Unclear — sebajun2 · 2026-11-16
- One 16GB GPU runs songs, voice, images, 720p video and local RAG — all offline and open source — llama-of-death · 2026-11-16