B300 Inference Throughput Hits Multiple Times DeepSeek's
teortaxesTex · x · 2026-07-08
The B300 NVL72 paired with Dynamo achieves an 8K context per card at 80 tps, while DeepSeek using DSpark reaches about 1K context at the same 80 tps. If DeepSeek utilizes the H800 or 950 series, the performance-per-watt gap is at least 4x, though they remain roughly on par in terms of capital expenditure per dollar.
More from Infra
- Surprising Ubuntu Setup: NVIDIA 5090 PC Becomes the Easiest AI Rig — _xjdr · 2026-07-27
- TSMC reportedly plans 5%–10% price hikes in 2027 to cover rising costs — Beth_Kindig · 2026-07-27
- Anthropic says Claude Code can drop 80% of its system prompt with no coding loss — krishnan · 2026-07-27
- Dhruv Bhatia joins fal to work on video and world models — gorkem · 2026-07-27
- Moonshot’s Kimi K3 lands on Together with reserved throughput and 65% lower cost — togethercompute · 2026-07-27
- NVIDIA says Vera CPU is speeding up next-gen CPU and GPU design cycles — nordicinst · 2026-07-27