Ion Stoica explains why complex AI workloads increasingly fit Ray's design
PyTorch · x · 2026-11-20
At PyTorch Conference North America 2026, Ion Stoica (UC Berkeley / Anyscale) traces the industry shift from pre-training scaling to post-training and multimodal models, which brings higher workload complexity, hardware heterogeneity and scale — demands that map onto Ray's origins as a distributed framework built for reinforcement learning. The full keynote covers Ray's evolution across data processing, training, serving and post-training, plus plans for tighter Kubernetes integration and better accelerator support.
More from Infra
- Gary Marcus: market crash, outage chaos and Jensengate make a perfect AI storm — GaryMarcus · 2026-11-20
- Nvidia down ~40% from October peak as Anthropic IPO pops 34% above expectations — The Verge AI · 2026-11-20
- GPU rents up, token prices down: inference providers' break-even load jumps 22%–75% in 5 months — AccBalanced · 2026-11-20
- Missing config file was throttling GPUDirect Storage — fix yields 3x reads, 9x writes — AccBalanced · 2026-11-20
- NVIDIA Dynamo cuts RL rollout bottlenecks with KV-aware routing and delta weight updates — NVIDIAAI · 2026-11-20
- Arm reaches the AI laptop: Surface Laptop Ultra runs 120B models locally — kimmonismus · 2026-11-20