Magnitude: open-source server picks the best local models for your hardware and plugs into your coding agent

solyarisoftware · x · 2026-09-05

Magnitude is an open-source inference server (2.7k GitHub stars) that profiles your machine and ranks local models by speed, accuracy, intelligence, and memory requirements. It then downloads, tunes, and serves them, plugging directly into agent harnesses you already use — Pi, OpenCode, Claude Code, Codex, Cline and more.

Setup is two commands: npm i -g @magnitudedev/cli then magnitude setup. The result is fully local, offline agent work with no token costs and no API keys. The author also published a detailed guide on running agent harnesses with local models.

Original post →

More from coding & agent

coding & agent channel →