PyTorch Con Demo Theater: 13 talks including Wan 2.2 video generation sped up 53.6x
PyTorch · x · 2026-10-22
PyTorch previewed Wednesday's Demo Theater at PyTorch Conference with 13 presentations spanning training, inference, hardware enablement, and agentic workflows:
- RL on AWS Trainium via TorchNeuron, with TorchTitan training, vLLM-Neuron rollouts, Monarch orchestration, and TorchStore weight syncing.
- Baseten on Wan 2.2 inference: a five-second video generated in under three seconds — a 53.6x speedup over baseline using timestep distillation, custom kernels, and four-bit quantization.
- Verda Cloud's WideEP: expert-parallel MoE inference on an NVIDIA NVL72, monitored through a Rust-based frontend.
More from Infra
- Thread: speculative decoding speeds up inference without changing weights or sampling — cneuralnetwork · 2026-10-22
- Speculative Decoding Explained: How Draft Models Yield k+1 Tokens Per Pass Without Changing the Distribution — cneuralnetwork · 2026-10-22
- Cloudflare reveals it powers OpenAI's ChatGPT sites with Workers and D1 — ritakozlov · 2026-10-22
- DeepSeek has open-sourced every layer of an AI lab, from weights to inference engine — examachine · 2026-10-22
- Meta's Prometheus: hyperscale GPU clusters run at 87% usable, 13% kept as hot spares — SumitGup · 2026-10-22
- Redditor converts missing models to OpenVINO IR and takes requests — Sudden_Topic5154 · 2026-10-22