Inkling Lands on Modal Endpoints
andersonbcdefg · x · 2026-07-16
The post shares news of Inkling's launch: the model is now available on Modal's first endpoint with token-based billing.
Two implementation details are highlighted: first, Inkling was released by @thinkymachines; second, Modal uses a custom DFlash speculator, reportedly delivering 67% higher throughput and interactivity. It currently runs on Modal Auto Endpoints using SGLang.
Related event: Modal adds Inkling to Auto Endpoints with DFlash acceleration(5 posts)→
More from Infra
- Anthropic's $430B compute contracts are noncancelable, topping China's military budget — xiaosun86 · 2026-10-27
- AI Infra Meme: While Countries Need TW-Scale Power for Datacenters, People Argue About Lightbulbs — mgostIH · 2026-10-27
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27
- Cloud release velocity scores: AWS 95, Azure 90, Google Cloud 82 — DavidLinthicum · 2026-10-27
- Selling a 5090 to scale local inference: one business weighs 5 hardware paths — Anarchaotic · 2026-10-27
- AWS tutorial: fleet-wide edge CV model lifecycle with SageMaker SDK v3, ~$0.07 per run — AWS ML Blog · 2026-10-27