Magnitude open-sources Apple silicon inference server that auto-tunes local models for your Mac

nickbaumann_ · x · 2026-09-09

Magnitude is an open-source inference server for Apple silicon (4.2k GitHub stars) that profiles your Mac, recommends and downloads the best local models, tunes and runs them, then plugs into Pi, OpenCode, Codex, Claude Code, Cline and more. Its Pi extension shows live model loading/unloading, prefill progress, cache hits, plus TTFT and tok/s per response.

Original post →

More from coding & agent

coding & agent channel →