Discussing Compute Bottlenecks at ICML
avt_im · x · 2026-07-20
In a conversation at ICML, the author heard a student of Jimmy Ba say that his biggest bottleneck in doing LLM reinforcement learning research was not having enough compute to run meaningful experiments. If even he faces this, it's much harder for other researchers to push forward.\n\nA follow-up point added that without Chinese open-source toolchains helping to squeeze every drop of performance out of existing GPUs, he likely wouldn't have been able to complete this work or acquire the skills needed for today's cutting-edge experiments.
Related event: Academic Compute Bottlenecks Partly Eased by Chinese Open Source Tools(3 posts)→
More from Infra
- Tabul AI launches Metal TreeSHAP to speed up Shapley values on Apple silicon — Scobleizer · 2026-07-22
- DeepSeek-V4-Flash tops out at 770 tok/s on one B300 in a vLLM batch test — Moreh · 2026-07-22
- NVIDIA starts shipping 102.4 Tbps Spectrum-6 switches for Vera Rubin AI factories — nvidia · 2026-07-22
- Apple publishes SOC 3 audit reports for Private Cloud Compute — throwfaraway4 · 2026-07-22
- Reddit GPU renters say existing platforms only give you two of three: code, recovery, fair billing — legendpizzasenpai · 2026-07-22
- The Sandboxing Manifesto: Secure Execution Environments for Agents — spirosoik · 2026-07-22