Together Compiler: continual compilation for AI inference across shifting model architectures
appenz · x · 2026-11-06
Together's research team introduced the Together Compiler, a continual compilation system for AI inference, announced by simransarora and praised by co-founder appenz.
Key observation: today's inference is "polymorphic" and shape-shifting —
- 80% of OpenRouter traffic goes to models released in the last three months
- The ten most popular open models each use a different architecture
Static compilation can't keep up with this churn; the compiler continually adapts inference to rapidly changing model architectures. Full details in the paper.
Related event: Together AI Unveils TKCC, an Agentic Continuous Compiler for Inference(25 posts)→
More from Infra
- Hyperkernel generates SOTA megakernels across 11 domains, now on GitHub — MillionInt · 2026-11-06
- Musk: space will be the cheapest place to run superintelligence in 2-3 years — XFreeze · 2026-11-06
- Ex-Microsoft engineer: Azure runs 1M+ VM services, adds a datacenter every 4 days — viksit · 2026-11-06
- Mystery seller auctions $500M in data center loans, including Stargate financing — SumitGup · 2026-11-06
- Vercel launches Schedules public beta: agents can create cron jobs at runtime — cramforce · 2026-11-06
- Harbinger raises $240M Series D as electrification becomes an AI-era bottleneck — NYCounihan · 2026-11-06