GLM-5.3-Flash hits 1,005 tok/s locally on dual RTX PRO 6000 Blackwell cards
BanghuaZ · x · 2026-09-03
A new entry on the Localmaxxing leaderboard: GLM-5.3-Flash reached 1004.9 tok/s decode speed on two RTX PRO 6000 Blackwell cards (2×96 GB VRAM). The site tracks local inference speed tests with TTFT, VRAM usage, and per-hardware filters.
More from Infra
- Developer Moves AI Agents to a Dedicated Linux Workstation Using Incus System Containers — kevinkern · 2026-10-21
- Nvidia guides 70% growth citing unmet AI demand, while media panics over a $500M Korean neocloud IPO — firstadopter · 2026-10-21
- Pichai: everyone is massively short on AI compute — 'everyone wishes you had two times what you had planned' — firstadopter · 2026-10-21
- Stanford CS336 Lecture 6: fused Triton kernels cut softmax memory traffic ~4x — stanfordnlp · 2026-10-21
- General Compute partners with Positron AI: Atlas memory-centric hardware ships Q1 2027 — aftahi_ai · 2026-10-21
- AI bond issuance hits $419B in 2026, up 90% from all of 2025 — SumitGup · 2026-10-21