Open-source agent beats Hermes on GAIA with the same local Qwen-3.6-35B setup
SucceededMind · x · 2026-07-25
Orchestration, not bigger weights, appears to be the lever that matters here.
The post cites a benchmark run where Atomic Agent and Hermes Agent were tested on 53 GAIA Level 1 tasks with the same local setup: a 4-bit Qwen-3.6-35B model on an M4 Max.
- Atomic Agent: 69.8% solved in 3h 12m
- Hermes Agent: 58.5% solved in 5h 10m
That means Atomic solved 6 more tasks and finished almost two hours faster.
The claimed reason is a stricter agent loop that avoids wasting compute: it reuses the KV cache with a byte-stable prompt, batches tool calls as JSON, and compresses results instead of stuffing raw logs into context.
More from coding & agent
- Astra storyboards plus Minimax H3 per-shot generation boost video success rates — Hailuo_AI · 2026-09-11
- Codex tip: use Sol with Astra and Luna sub-agents to save usage — pvncher · 2026-09-11
- agents-best-practices: a provider-neutral Agent Skill for designing and auditing agentic harnesses — tom_doerr · 2026-09-11
- Cognition's SWE-2 uses a KKT duality argument in RL to shift the effort Pareto curve — YouJiacheng · 2026-09-11
- First-ever Three.js Conference lands in Paris, with a panel on AI-shortened design workflows — OdinLovis · 2026-09-11
- Agile co-author Ron Jeffries publishes 'Resist AI', urging developers to push back — mborch · 2026-09-11