NVIDIA Shows How to Serve 753B-Parameter GLM-5.3 Across Two DGX Stations with vLLM

NVIDIA Developer · youtube · 2026-11-14

NVIDIA published a tutorial on locally serving GLM-5.3, a 753-billion-parameter MoE model whose NVFP4 checkpoint (464 GB) exceeds a single GB300's 252 GB memory.

Method and verification:

Use cases: sensitive data, local agent prototyping, and per-token-cost-free prompt iteration. The playbook and tech blog include every command.

Original post →

More from Infra

Infra channel →