Magnitude open-source inference server swaps coding agents to free local models automatically
nickbaumann_ · x · 2026-09-03
Magnitude (1.6k GitHub stars) is an open-source inference server that profiles your hardware, recommends the best local models, and plugs them into the coding agent you already use.
- Author demo: Hermes agent switched itself to 100% free local models via the Magnitude CLI, running Qwen 3.6 35B-A3B at 60 tok/s on a DGX Spark — free, private, always-on for background tasks
- The agent handles the migration itself: hardware profiling, model selection, and switchover; models load just-in-time and unload when idle
- Works with Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code, Oh My Pi, and Cline
- One-liner onboarding: npm i -g @magnitudedev/cli, then magnitude docs onboarding.
More from coding & agent
- LLM one-shots a Minecraft 3x3 piston door by building its own Linux test infra — Vjeux · 2026-10-18
- Dev builds Mumbai-inspired 3D manga background generator from OpenStreetMap data — CurieuxExplorer · 2026-10-18
- Solo founder builds a money-printing data service on Claude's Pi Durable harness — MicahBerkley · 2026-10-18
- Dev builds Arch-based OS with custom desktop and browser using Claude Code — Snoo-10493 · 2026-10-18
- Five SaaS agent workflows fail the same way — and it's never model intelligence — usehive · 2026-10-18
- Claude skill generates hand-drawn interactive diagrams that teach kids how things work — CatAstro_Piyush · 2026-10-18