NVIDIA open-sources GPU scheduler Run:ai, Lambda ships it in Kubernetes Service
TheZachMueller · x · 2026-10-13
NVIDIA has open-sourced Run:ai, its GPU scheduler for Kubernetes, reducing lock-in concerns. Lambda, which has supported Run:ai since 2022, is making it a first-class option in Lambda Kubernetes Service alongside Slurm, Kubernetes, and SkyPilot. Run:ai adds two things the default K8s scheduler lacks: GPU fraction sharing (multiple workloads share one GPU's memory) and quota-based scheduling (guaranteed allocations with idle-capacity borrowing), materially raising utilization on shared clusters. Node-level auto-remediation ships in LKS today.
Related event: NVIDIA Open-Sources Run:ai GPU Orchestration Platform(3 posts)→
More from Infra
- llama.cpp ships inside Google's Android AICore powering Gemini Nano — ggerganov · 2026-10-14
- FLAT brings open-source linear attention training kernels to TPUs, up to 3x faster — SonglinYang4 · 2026-10-14
- Artist built a 300-clip immersive exhibition with MiniMax H3, benchmarks GPU render times — komarco · 2026-10-14
- Nvidia reportedly to announce $28B AI investment in Europe this week — rchardkovacs · 2026-10-14
- RISC-V crypto accelerator SoC gets full place-and-route done with ~$2,000 of LLM tokens — IgorCarron · 2026-10-14
- SK Hynix has struggled with HBM4 back-end issues for over a year, Samsung tipped to lead HBM market next year — zephyr_z9 · 2026-10-14