NVIDIA Groq 3 LPX Enters Production with 3,400 Tokens/sec for Agentic AI
heypearlai · x · 2026-08-25
NVIDIA announced that the Groq 3 LPX interactive AI inference accelerator is now in full production. Extending the Vera Rubin platform, the chip achieved a record 3,400 tokens per second with a 100k context window on the Gemma 4 31B model. Nebius is the first AI cloud to adopt the chip. This advancement dramatically accelerates token generation for latency-sensitive agentic workflows like coding.
More from Infra
- Copper to optical: optical backplanes seen as necessary as racks move to optics — BenBajarin · 2026-10-16
- Polymarket prices 28% odds a US state enacts data center moratorium by year-end — Polymarket · 2026-10-16
- Pennsylvania residents reject $10,000-per-household offer for massive Amazon data center — Polymarket · 2026-10-16
- PyTorch now runs natively on AWS Trainium with zero code changes — PyTorch · 2026-10-16
- Chinese labs run on ~1/10 US compute; ByteDance pays 2-4x to hoover up SEA supply — robleclerc · 2026-10-16
- Zymtrace raises $12.2M and hires ML engineers to build agents that fix GPU bottlenecks — cfregly · 2026-10-16