B300 Inference Throughput Hits Multiple Times DeepSeek's
teortaxesTex · x · 2026-07-08
The B300 NVL72 paired with Dynamo achieves an 8K context per card at 80 tps, while DeepSeek using DSpark reaches about 1K context at the same 80 tps. If DeepSeek utilizes the H800 or 950 series, the performance-per-watt gap is at least 4x, though they remain roughly on par in terms of capital expenditure per dollar.
More from Infra
- vLLM eyes Rust migration as inference engines race to rewrite the stack — AccBalanced · 2026-10-27
- Anthropic's S-1 reveals up to $567B compute spend and self-built data centers — jeremyakahn · 2026-10-27
- Resin lets an agent build standalone LLM inference engines; vLLM and SGLang optimize DeepSeek kernels differently — AccBalanced · 2026-10-27
- Local benchmark: Flint matches Qwen3.6 quality at 50/52 while running 3.6x faster on M4 Pro — RichardSocher · 2026-10-27
- Anthropic S-1: CSP marketplace revenue jumped from 11% to 48% in three years — AccBalanced · 2026-10-27
- Alchemy adds effect/Workflow support across Durable Objects, Workflows and Lambda Durable Functions — samgoodwin89 · 2026-10-27