Modal launches Sticky Sessions: serverless containers that keep state across requests
graceisford · x · 2026-10-31
Modal's new Sticky Sessions route every request in a session to the same container, built on low-latency Modal Servers via a @modal.sessioned() decorator — targeting voice agents, streaming speech-to-text, and multiplayer games. The post also recounts how Phonic stuck with Modal thanks to sticky routing and hands-on support, with engineers debugging infra together until 2 AM.
More from Infra
- ClickHouse discloses unauthenticated RCE vulnerability CVE-2026-116366, patches available — Hacubu · 2026-10-31
- Stanford paper proposes rewriting scaling law: optimal synthetic data share rises to 32% with compute — stanfordnlp · 2026-10-31
- Count document passes, not tokens: batching questions cuts LLM scoring cost — petrusenko_max · 2026-10-31
- Budget dual-RTX 3060 12GB local inference rig beats a 5060 16GB setup on VRAM per dollar — Frizzy-MacDrizzle · 2026-10-31
- Nvidia's enterprise/neocloud segment growing 138.5% could overtake hyperscalers in 2-6 quarters — Beth_Kindig · 2026-10-31
- Nvidia's ACIE segment could overtake hyperscalers in 2-6 quarters, analyst estimates — Beth_Kindig · 2026-10-31