antirez Tunes DwarfStar to 170 t/s Generation on Station

Redis creator antirez reported that after roughly 48 hours of optimization, the DwarfStar inference engine on Station achieved 170 t/s generation (without DFlash) and 22k tokens/s prefill using MXFP4 and Flash models.

2026-08-17 ~ 2026-08-17 · 2 related posts

Full story(2 episodes)→