Google's VeriHarness shows agent agreement hides shared errors, gains 6+ points with agentic verifier
omarsar0 · x · 2026-10-04
A new Google paper challenges the standard practice of trusting agent rollouts that agree: consistent answers can hide shared errors, while disagreement often points to the correct alternative.
VeriHarness turns the same base model into an agentic verifier with two jobs:
- Resolve claims where rollouts disagree by checking workspace evidence
- Challenge claims every rollout agrees on, hunting for requirements they all missed
Across five long-horizon benchmarks it posts the best selection scores among baselines tested. With evidence-backed revision it adds 6.2 points over a single rollout on Gemini 3.5 Flash and 6.4 on Claude Opus 4.8. The authors also release about 26,000 rollouts.
Related event: Google's VeriHarness Turns Consensus on Its Head for LLM Verification(3 posts)→
More from coding & agent
- TanStack AI adds experimental text-to-GLB 3D model and prompt-to-motion animation generation — bennash · 2026-11-20
- Dev builds typing survival game with troops and skill trees in ~24 hours using agents and kaigen3d — hullabaloo22 · 2026-11-20
- Harmonic's Aristotle writes proven-correct fusion plasma controllers in C and Verilog in 4 hours — satnam6502 · 2026-11-20
- R3 Code: A Native Rust Mac Client That Runs All Your Coding Agents — jasonkneen · 2026-11-20
- zlib: 2.4K-star open-source CLI turns Z-Library into a skill for AI agents — udmrzn · 2026-11-20
- Andriy Burkov's True Positive Weekly #186: what to know when agents do the work — burkov · 2026-11-20