753B-parameter GLM-5.3 served fully in GPU memory across two NVIDIA DGX Stations
kuchaev · x · 2026-11-20
NVIDIA's RTX account showcased Zai.org's GLM-5.3 (753 billion parameters) running across two NVIDIA DGX Stations with weights fully resident in GPU memory, served via vLLM behind a single local API — desktop-grade local deployment for a frontier-scale model.
More from Infra
- Touchmark raises $3M seed to build a commodities-style exchange for AI inference contracts — ycombinator · 2026-11-20
- Analytical instruments, not models, may be China's toughest biotech chokepoint — PAstynome · 2026-11-20
- PolyAI's real-time dialog model Dialog-RSN-1 lands on SageMaker JumpStart — AWS ML Blog · 2026-11-20
- Three decommissioned V100s in a $1,042 rig beat a $5,399 Mac Studio at long contexts — bittingthembits · 2026-11-20
- NVIDIA's Rubin debuts in MLPerf Training and Inference as benchmark maintainer congratulates strong quarter — TheKanter · 2026-11-20
- Halocline: hand-rolled CUDA engine runs Qwen4 on one RTX 4090, up to 2.6x faster than Strata — Distinct-Pie2389 · 2026-11-20