Pipeshift claims 40% faster first token than Sarvam serving Gemma 4 31B at 150B tokens/day

NirantK · x · 2026-11-17

Sarvam AI says its Token Factory serves Gemma 4 31B for real-time conversations with 5× faster first token and 1.6× more tokens/s than the only other provider, already serving 150 billion tokens daily. Pipeshift then published benchmarks pushing back: on identical hardware (1× B300, 11.2K prompt, single stream, P50), Pipeshift hits 0.24s TTFT vs Sarvam's 0.40s (40% lower) and 359 vs 308 tokens/s (20% higher).

Original post →

More from Infra

Infra channel →