India's Sarvam launches Token Factory: 8 open models, 0.2s TTFT on a B200 cluster

itsOmSarraf_ · x · 2026-11-16

Indian AI firm Sarvam announced Token Factory, an inference platform exposing 8 open models through one OpenAI-compatible API. Claimed numbers: 0.2s time-to-first-token at 330 tokens/s for Sarvam 105B, 5x faster TTFT for Gemma 4 31B versus other providers, 450B+ tokens served daily including DeepSeek V4.1 Flash, and 95.7% of prompt tokens served from cache. It runs on India's largest B200 cluster, aiming to make top open models accessible at scale.

Related event: India's Sarvam Launches Token Factory, Hosting Open-Weight Models Domestically(15 posts)→

Original post →

More from Infra

Infra channel →