Gemma 4 31B hits 3,431 tokens/s on NVIDIA Groq 3
GlennCameronjr · x · 2026-08-27
Benchmarks on NVIDIA's Groq 3 LPX accelerator show Gemma 4 31B achieving a median output of 3,400 tokens/s across 10k and 100k input sequences, setting a new speed record for the model at 100k context.
Related event: NVIDIA Groq 3 LPX Hits 3,400+ tok/s Decoding on Small Models(2 posts)→
More from Infra
- ASML CFO says US Match Act restricting DUV sales to China would backfire — pstAsiatech · 2026-10-15
- Bloomberg breakdown: a 1GW Texas AI data center may need nearly $3B for overruns alone — rohanpaul_ai · 2026-10-15
- 7 System Design Algorithms to Know: Merkle Trees to CAP/PACELC — goyalshaliniuk · 2026-10-15
- MiniCPM-V 4.7 runs a 35B MoE multimodal model on phones with just 3GB memory — nevrekaraishwa2 · 2026-10-15
- Sipeed MaixStation product page goes live for edge AI dev — xlltt · 2026-10-15
- Nvidia Is Now Worth More Than the Entire Indian Stock Market — theteknosaur · 2026-10-15