Open-source inference project llm-d to share scaling news at PyTorch Conference
PyTorch · x · 2026-10-13
IBM Distinguished Engineer Carlos Costa will share llm-d updates at PyTorch Conference North America (San Jose, Oct 20-21). A year after founding, the open-source project delivers state-of-the-art generative serving plus multi-tenant QoS and zero-downtime operations.
More from Infra
- HF's Zach Mueller: don't do this — most users can just rent or run sandboxes locally on CPUs — TheZachMueller · 2026-10-13
- Celesto CI undercuts GitHub Actions 9x: 1000 jobs for $6.67 vs $60 — aniketmaurya · 2026-10-13
- Keurig coffee maker flooded Wi-Fi with 1TB in 10 days — owner says unit bug — gnukeith · 2026-10-13
- oQe Quantization Update Cuts Code KL Divergence by Up to 18% Across 69 Models — huggingface · 2026-10-13
- Rodolfo Rosini on 2040: cheap compute everywhere, devices jumping orders of magnitude — MikePFrank · 2026-10-13
- AI inference chips are a $225bn market: Vaire on why startups avoid silicon and its Nvidia-adjacent plan — MikePFrank · 2026-10-13