GLM-5.2 Throughput on GB10
ciprianveg · reddit · 2026-07-15
A user benchmarked GLM-5.2-Int4-Int8 on 8× GB10:
- prefill at roughly 1,200 t/s
- average decode at 33–54 t/s (depending on general/coding structured tasks)
- noted the ability to run a Mimo 2.5 concurrently for image/audio inputs
- both tasks utilize tp 8
This highlights deployment and inference performance on specific hardware rather than announcing a new model release.
More from Infra
- Engineer with thousands of fabricated devices pours cold water on photonic crystal modulator yields — jwt0625 · 2026-10-26
- Anthropic S-1 reveals 48 cents of compute cost per dollar of Q2 revenue — nmasc_ · 2026-10-26
- Persistent AI joins UR network to route private AI inference with encrypted, IP-hidden traffic — 0xSammy · 2026-10-26
- Anthropic's disclosed compute commitments: $114.5B Google, $161.2B Broadcom top the list — BenBajarin · 2026-10-26
- SpaceX strikes $40B deal with Apollo Global to lease AI chips and data center hardware — Polymarket · 2026-10-26
- SpaceX AI revenue up 830%, Claude designs 318K antivenom proteins in 64 hours — PeterDiamandis · 2026-10-26