ICML Optimization Tutorial Completely Reshapes Neural Network Training Intuition
zmkzmkz · x · 2026-07-06
Professor Mark Schmidt's optimization tutorial presented at ICML has received high praise, covering the foundational principles of optimizers and neural network training. The author notes that the tutorial completely reshaped their intuitive understanding of optimizers and plans to review the slides repeatedly. The presentation materials are now available for download.
Related event: ICML 2026 Neural Network Optimization Tutorial Reshapes Intuitions(3 posts)→
More from Research
- LightMTP: lightweight latent multi-token prediction boosts LLM planning in pretraining — gdm3000 · 2026-10-27
- EMNLP study: AI literary translation reads fine but varies more, even within one book — tuvllms · 2026-10-27
- Lab monkeys at $30-80K each: a 4-year breeding cycle is the real preclinical drug bottleneck — zebird0 · 2026-10-27
- OpenAI Foundation funds UNC tumor antigen project, hiring senior experimental scientist — iskander · 2026-10-27
- Steering attention heads toward honesty: up moral patienthood, down psychopathy — edelwax · 2026-10-27
- Are transcoders overkill? New paper argues plain neurons suffice for circuit analysis — burny_tech · 2026-10-27