GLM 5.3 Flash EXL3 adds TP=3 mode: 28% faster decode across three DGX Sparks
HankYeomans · x · 2026-09-15
MiaAI Lab added a TP=3 path to GLM 5.3 Flash EXL3 (4bpw, 164 GiB), letting the model run across three NVIDIA DGX Spark units with 28% faster decode and 9% faster prefill vs TP=2, plus 3.2M KV cache and 1M context. A new head-weight-sharing option (NFSSHARE=1) frees space on other devices. The OpenAI-compatible vLLM setup is open-sourced on GitHub (498 stars) with ready-made TP3/TP4 launch scripts.
More from Infra
- To dethrone Postgres, new databases must prioritize ecosystem integrations from day one — mgill25 · 2026-11-02
- ESP32-powered 4-inch touchscreen builds a TUI dashboard for monitoring a DGX inference cluster — CATLLM · 2026-11-02
- OpenRouter crosses 10 quadrillion annualized token run rate, doubling every 10.5 weeks — deedydas · 2026-11-02
- Palmer Luckey asks: can you use datacenter RAM for things prohibited by the operator's terms of service? — avaitopiper · 2026-11-02
- Disable MTP for 20-30% faster local LLM inference on limited RAM — InternalMode8159 · 2026-11-02
- Kioxia up 216% in a year but down 68% from its June 2026 peak — zephyr_z9 · 2026-11-02