Basalt engine runs Inkling-2-Mini at 613 tps on one RTX 5090, 3x faster than llama.cpp

udmrzn · x · 2026-11-23

The developer behind the Basalt inference engine keeps pushing local LLM speeds:

Original post →

More from Infra

Infra channel →