Running GLM 4.5 Air locally on 128GB: a dev's three-tier routing harness for real dev work
bryancostanich · reddit · 2026-10-15
Developer bryancostanich is polling Reddit on using open-weight local models for actual development, while describing the three-tier routing in his open-source harness Cercano:
- Primary — the main agent, via ChatGPT/Claude accounts
- Secondary — delegated tasks; the author uses GLM 5.3 + GLM 5.3 Air (slow but capable vs. fast and nearly as capable)
- Local — truly local tasks (git workflows, docs, code search/summarization) via llama-server running GLM 4.5 Air on a 128GB machine, using 96GB RAM at 128K context
He reports Qwen3, Gemma3 and older DeepSeek models were disappointing by comparison, suggesting benchmarks overstate small models' real dev experience. He wants community input to build out-of-the-box configs for 48GB/96GB machines.
More from coding & agent
- OpenJet claims Qwen3.8-27B coding runs 1.9x faster than llama.cpp on one RTX 3090 — JeremyCMorgan · 2026-10-23
- Building an autonomous SEO agent in Hermes with three skills: programmatic pages, Keywords Everywhere, DataForSEO — EXM7777 · 2026-10-23
- Building a sports betting AI agent with onchain execution and human approval by default: architecture and lessons — Dry-Comfortable-2678 · 2026-10-23
- Capy 0.5.0 lets Claude Pro/Max subscribers reuse their plan quota, adds OIDC cloud access — garrytan · 2026-10-23
- You.com CEO Richard Socher: legacy code is human slop, let AI clean it up — RichardSocher · 2026-10-23
- Let agents design a single-line glance component so you can track them from the sidebar — blixt · 2026-10-23