Discussing Compute Bottlenecks at ICML
avt_im · x · 2026-07-20
In a conversation at ICML, the author heard a student of Jimmy Ba say that his biggest bottleneck in doing LLM reinforcement learning research was not having enough compute to run meaningful experiments. If even he faces this, it's much harder for other researchers to push forward.\n\nA follow-up point added that without Chinese open-source toolchains helping to squeeze every drop of performance out of existing GPUs, he likely wouldn't have been able to complete this work or acquire the skills needed for today's cutting-edge experiments.
Related event: Academic Compute Bottlenecks Partly Eased by Chinese Open Source Tools(3 posts)→
More from Infra
- RTK Terminal Compression Cuts Tokens but Leaves Your AI Coding Bill Unchanged — Bartaseth · 2026-09-11
- SF Compute founder: buying compute is 'an absolutely awful experience' right now — IgorCarron · 2026-09-11
- SmolVM open-sources persistent computer infrastructure for agents that outlive chat sessions — aniketmaurya · 2026-09-11
- PyTorch Day Korea 2026 launches first offline conf, CFP closes Sept 13 — PyTorch · 2026-09-11
- Local LLM server dilemma: 4x CMP-170HX (price up 53% in 20 days) vs Mac Studio M5 Ultra — rumboll · 2026-09-11
- llama.cpp lands Flash Attention tuning for RDNA4, big prefill gains on AMD — pmttyji · 2026-09-11