DwarfStar + DGX Spark achieve 25 t/s decoding with DeepSeek v4
antirez · x · 2026-08-23
Enabling the new feature on DGX Spark boosts decoding speed to 25 t/s. Combined with a massive 850 t/s prefill speed, the DwarfStar + DeepSeek v4 Flash combo delivers a good experience. The latest DwarfStar version introduces "opportunistic DSpark," a compromise between speed and sampling correctness that accepts greedy continuations during t=0.
More from Infra
- Micron plans $10B Idaho lab for advanced memory and compute systems — Beth_Kindig · 2026-08-23
- Small town reaction to AI data centers: "Free money machine" or existential threat? — kyliebytes · 2026-08-23
- Expert debunks Nvidia Rubin's 10x performance claim as cherry-picked — zephyr_z9 · 2026-08-23
- Satirical startup idea: anger-powered electricity for AI data centers — djcows · 2026-08-23
- AI observability must track behavior, not just health, across four layers — dl_weekly · 2026-08-23
- Alibaba to Issue $10B in New Shares for Global AI Push — nugurimt · 2026-08-23