TypeSafeAI's Jev served a trillion tokens on Modal within three days of launch
josh_wills · x · 2026-10-08
A case study shared by Modal: TypeSafeAI's product Jev launched on a Thursday and by Sunday had served a trillion tokens on Modal, with no signs of the load slowing down. The poster jokes that the team is good at both scaling and running bus shelter ads.
Related event: TypeSafeAI Serves 1 Trillion Inference Tokens in Days on Modal(2 posts)→
More from Infra
- GitHub Copilot will offload tasks to local models like MAI-Code-1.1 Flash via HydraFusion — mariorod1 · 2026-10-08
- Microsoft launches Surface Spark with Nvidia: $6k for 128GB, odd form factor — casper_hansen_ · 2026-10-08
- Google launches first test satellite carrying 4 TPUs for its space-based ML infrastructure moonshot — CurieuxExplorer · 2026-10-08
- GPU rental platform Lium hits all-time-high utilization, courts idle GPU owners with 95%+ revenue share — const_reborn · 2026-10-08
- Marvell details Google chip deal worth up to $120B as inference accelerators split from TPUs — demian_ai · 2026-10-08
- llama.cpp Takes the Stage at Microsoft's Windows Event, Creator Celebrates Local AI Milestone — ggerganov · 2026-10-08