GLM-5.2 Throughput on GB10
ciprianveg · reddit · 2026-07-15
A user benchmarked GLM-5.2-Int4-Int8 on 8× GB10:
- prefill at roughly 1,200 t/s
- average decode at 33–54 t/s (depending on general/coding structured tasks)
- noted the ability to run a Mimo 2.5 concurrently for image/audio inputs
- both tasks utilize tp 8
This highlights deployment and inference performance on specific hardware rather than announcing a new model release.
More from Infra
- Why a 1GW Chinese AI data center may be plausible after all — teortaxesTex · 2026-07-22
- China’s AI arms race is increasingly defined by chips, data centers, and open models — BenBajarin · 2026-07-22
- Agent search bottlenecks are now about variance, not raw latency — rohanpaul_ai · 2026-07-22
- Gavin Baker argues Nvidia may be one of open source AI’s biggest supporters — GavinSBaker · 2026-07-22
- AI Power Demand Exposes US Energy Gap, Urging Shift from Scarcity to Abundance — bradneuberg · 2026-07-22
- Gavin Baker says Nvidia’s $630B figure would be system revenue, not all Nvidia’s — GavinSBaker · 2026-07-22