Benchmarked token-saving tools RTK vs Headroom: barely cheaper, both together cost most
Delicious-Flan88 · reddit · 2026-09-09
A controlled test of the two most-starred token-saving repos, RTK and Headroom, on GPT-6 Astra: 5 Rust coding tasks, 4 setups (no tool / RTK / Headroom / both), 3 runs each — 60 sessions, all correct, priced with caching.
- No tool: $0.154; RTK: $0.139; Headroom: $0.158; both: $0.175 (most expensive)
- RTK won consistently only on a multi-file grep task (87 lines grouped into 29, needed line preserved)
- Headroom won its target JSON task 3/3 runs ($0.0054 vs $0.0066)
- Elsewhere costs varied more with the model's own command choices than tools: 9 of 20 cells within 10%, one spread by 13x
- All commands and raw-vs-RTK outputs published for verification
Related event: Tests Show Token-Saving Tools Like RTK Fail to Cut AI Bills(2 posts)→
More from coding & agent
- Inspired by OpenAI's 10,000-agent run, dev open-sources a crowdsourced agent problem-solving platform — Benjaminsen · 2026-09-11
- Lucid: open-source Mac app keeps your laptop awake only while AI agents run — Pitiful_Hedgehog_600 · 2026-09-11
- banteg's snail project crowdsources AI agents to finish matching Snail Mail's 20 remaining functions — banteg · 2026-09-11
- Alex Townsend posts 200 open problems in numerical linear algebra for humans and AI agents — IgorCarron · 2026-09-11
- Kimi K2.8 Preview rolls out: near-K3 coding performance, 1M context for all tiers — teortaxesTex · 2026-09-11
- Looking for a classifier of software engineering task shapes to pick models per task — StewartalsopIII · 2026-09-11