Magnitude Open-Source Engine Hits Hacker News Top With Up to 2x llama.cpp Speed

Magnitude, an open-source local inference engine from YC S25, auto-compiles and tunes kernels for the user's hardware, delivering up to 2x faster decoding than llama.cpp (about 92% gains on Metal) and topped Hacker News.

2026-10-01 ~ 2026-10-01 · 3 related posts