Sarvam launches India-hosted Token Factory, shares how it 2x'd inference speed

itsOmSarraf_ · x · 2026-11-17

Indian AI company Sarvam has launched Token Factory, hosting its own models and a range of top open-weight models in India, matching leading inference providers on performance and reliability and offering enterprises a lock-in-free AI stack.

Alongside the launch, the team explains that a B200 cluster plus HF weights alone is far from enough: a long video walks through the engineering behind doubling serving speed on the same hardware, covering the inference engine, caching, and control-plane layers.

Original post →

More from coding & agent

coding & agent channel →