Magnitude: open-source inference engine that self-tunes kernels, up to 2x faster than llama.cpp
paranoidray · reddit · 2026-10-01
Magnitude is an open-source local inference engine (in the vein of LM Studio / Unsloth Desktop) that compiles and tunes its kernels on your device for your exact hardware:
- Claims open models run up to 2x faster than llama.cpp thanks to the per-device optimization
- Works on Apple Silicon, NVIDIA, AMD, or CPU-only machines
Available on GitHub (magnitudedev/magnitude).
More from coding & agent
- Why faster GPUs don't yield more tokens: H100 needs 295 ops per byte fetched — AccBalanced · 2026-11-16
- Developer teases game demo built with Fable 5.2, live Nov 18 — ChrisGPT · 2026-11-16
- Solo dev ships iPad math game for kids in ~2 days using Antigravity agent swarms — jacalulu · 2026-11-16
- Open-source MCP server lets Claude build a playable CS2 town from phone photos — SilentPrinciple8997 · 2026-11-16
- Redditor builds "Fish Report Tuesdays" on a 100% AI-made custom game engine — JynsRealityIsBroken · 2026-11-16
- 650 Lines of Formal Verification Burned 24 Hours of Inference, Sparking Doubts About AI Code-Verification Hype — ZeeshanZiaML · 2026-11-16