GLM 5.2 Speeds Up on DGX Spark
WesEklund · x · 2026-07-15
Shared details revealed an inference optimization test for GLM 5.2: after running on 2 DGX Spark units, the speed exceeded 18 tok/s.
The author explained that a key modification was made: quantizing the 3 largest attention projections to NVFP4, which still showed room for improvement compared to the original FP8. They also added that there is further room for optimization on both the speed and quality fronts.
More from Infra
- Tesla’s FSD v14 Lite is reportedly headed to 4 million older HW3 cars — MatthewBerman · 2026-07-21
- TSMC’s 3nm utilization reportedly tops 120% as AI demand drives a $190B capex cycle — tengyanAI · 2026-07-21
- Nativ brings local AI model running to Mac with a desktop app and localhost API — Simon Willison · 2026-07-21
- Octen says agent search now runs at 62ms P50 with only a 6ms P90 gap — aakashgupta · 2026-07-21
- Zhipu acquires a compiler-team spinout to optimize AI inference on domestic chips — zephyr_z9 · 2026-07-21
- Open reproduction of Meta’s REWIRE data pipeline cuts the cost to about $11 — vanstriendaniel · 2026-07-21