antirez's DwarfStar: adaptive VRAM/RAM expert placement runs DeepSeek V4 at 45 t/s
antirez · x · 2026-08-17
antirez (Salvatore Sanfilippo, creator of Redis) shares progress on his DwarfStar inference engine for DGX Station: running DeepSeek v4 PRO at Q2 quantization, routed experts are split between VRAM and RAM, with the engine adaptively migrating experts based on past token-generation usage so the hot set stays in VRAM. It currently reaches 45 t/s and can go faster. He calls this just the start of what's possible, reiterating his claim that DwarfStar could be the Station inference engine.
Related event: Redis Author Optimizes DeepSeek V4 to 45 t/s(3 posts)→
More from Infra
- Three CoreWeave co-founders have sold $3.3B in shares since IPO amid credit worries — SumitGup · 2026-10-16
- Cherry pi on a Raspberry Pi: the tiny-model rumor developers are watching — sull · 2026-10-16
- CoreWeave's debt costs falling: DDTL spreads tightened from S+9.62% to S+2.25% — BenBajarin · 2026-10-16
- SoftBank lines up US IPOs for SB Energy and AI robotics spinoff Roze, valuations top $50B — nordicinst · 2026-10-16
- TRL reproduces Modal's mixed-precision async RL: plain GRPO collapses, SC+MIS holds 0.72 — QGallouedec · 2026-10-16
- Hugging Face scales Indic pretraining with 2.8T tokens and an open data pipeline — Hugging Face Blog · 2026-10-16