A Mac coding-agent benchmark says the harness can cut token use 5×
asankhs · reddit · 2026-07-25
A benchmark on local coding agents on a Mac argues that the harness is a major part of the result.
- Using the same model (Qwen3.6-35B-A3B), OptiQ Code solved the same OpenBench tasks with about 5× fewer tokens than opencode.
- The chart shows mean tokens per solved task dropping from 82.6k for opencode to 16.8k for OptiQ Code.
- The takeaway: on a Mac, the harness is not a detail; it materially changes efficiency.
More from coding & agent
- Reticle builds a verification layer that lets AI coding agents check their own generated code — Scobleizer · 2026-10-27
- Dev training a guard model to block prompt injection, tool and memory poisoning — gnukeith · 2026-10-27
- Ex-Big Tech managers may thrive in the AI era: manage agents like you managed teams — lxfater · 2026-10-27
- SF 'Code Engineering' event picks up where 1,000-person harness engineering meetup left off — LangChain · 2026-10-27
- Prompt turns Claude Code into a forensics tool finding deleted iPhone photos in backups — alex_verem · 2026-10-27
- Phones won't be mobile IDEs but control planes for agent fleets, argues Yuchen Jin — Yuchenj_UW · 2026-10-27