Disaggregated inference is the future, says e/acc's Beff Jezos after panel with General Compute
beffjezos · x · 2026-10-07
Beff Jezos argues disaggregated inference is the future, citing a panel with General Compute on their heterogeneous compute cloud, the speciation of compute for disaggregated inference, and where thermo compute fits in. More announcements teased.
More from Infra
- NVFP4 runs a 2.4T-parameter model on a quarter of the GPUs, cutting per-token cost up to 73% — ryanshrout · 2026-10-07
- Intel exec: agentic AI spends real time waiting on business systems, end-to-end wall-clock is the metric that matters — ryanshrout · 2026-10-07
- Serving & Monitoring Local LLMs Across Three Mixed-GPU Machines Without Duct Tape — ziyaulhuk12 · 2026-10-07
- What Does 'Owning Your Own AI' Technically Mean? Locally Running Open Weights Debated — Imaginary_Choice_430 · 2026-10-07
- NVIDIA's LoGRA cuts LLM RL training memory by up to 45.7%, enables 27B RL on a single 8-GPU node — nvidia · 2026-10-07
- Ex-NVIDIA engineer tells the story of testing a chip with a broken memory controller — blelbach · 2026-10-07