Redis Author Optimizes DeepSeek V4 to 45 t/s

Redis author antirez demonstrated the DwarfStar inference engine, optimizing DeepSeek V4 PRO to 45 t/s via Q2 quantization and dynamic expert routing. The system adaptively migrates experts between VRAM and RAM based on usage.

2026-08-17 ~ 2026-08-17 · 3 related posts