Solo dev makes vLLM tokenization 120x faster with Elixir in under three days

AccBalanced · x · 2026-11-22

A retweet highlights that inference.net shipped "the fastest tokenizer in the world," built solo by @TheHarryET in under three days. The linked article explains the team has spent months investing in a custom inference request router built in Elixir, and this change makes vLLM tokenization 120x faster — first in a series of engineering posts.

Original post →

More from Infra

Infra channel →