Experiments use Qwen3.5-9B: runs on ~7GB VRAM in consumer laptops
yb2698 · x · 2026-10-14
The author chose Qwen3.5-9B for the experiments: a 9B model that runs with 7GB VRAM using a decent GGUF quantization, executable on most consumer laptops — well suited for large-scale repeated harness comparisons. The benchmark, Terminal-Bench Lite from the openthoughts team, is fast and gives the same signal as Terminal Bench 2.0 while being easier, making it better suited to small models.
More from coding & agent
- Creator builds custom GoPro ingestion tool with Codex: 4-camera array with WiFi trickle ingest — OpenAIDevs · 2026-10-15
- HybridAgent reasons in latent space, acts via text — 2x faster, 3x cheaper, open-sourced — zainhas · 2026-10-15
- Claude Code 2.1.300 ships 88 CLI changes, drops AskUserQuestion directive from system prompt — ClaudeCodeLog · 2026-10-15
- Tahoe AI opens Tara, a one-prompt plug-in connecting agents to its Tahoe-100M biology datasets — anshulkundaje · 2026-10-15
- sgrep cuts coding agent LLM costs 21.3% on SWE-bench versus ripgrep, fully local in Rust — udmrzn · 2026-10-15
- 10 GitHub repos that turn Claude Code and Codex into elite UI designers — udmrzn · 2026-10-15