NVIDIA DGX Station serves Qwen3.8-27B at 2,713+ tok/s peak
NVIDIAAI · x · 2026-08-20
Benchmarks show the NVIDIA DGX Station serving the Qwen3.8-27B model at BF16 full weight achieves over 2,713 tok/s peak aggregate throughput and 88 tok/s single-stream, effectively bringing datacenter-level performance to a home setting.
More from Infra
- Optical Networking Boom, Cisco's AI Strategy, and NVIDIA's $500B Datacenter Finances — BenBajarin · 2026-08-20
- LLM training speedup 19% by switching to built-in GELU — rasbt · 2026-08-20
- Data centers should be civic infrastructure built with pride and beauty — aronchick · 2026-08-20
- Databricks AI Extract achieves 95% accuracy on PDF field extraction — jefrankle · 2026-08-20
- Animation claims AI data center water use panic is over almost nothing — aronchick · 2026-08-20
- Virtuals: Robotics data can't be scraped like the web — ai · 2026-08-20