Hugging Face Engineer to Reveal Secrets of Training World-Class LLMs at CERN
Kyrannio · x · 2026-08-20
Hugging Face ML Engineer Lewis Tunstall is giving a talk at CERN titled "The Secrets to Training World-Class LLMs." The lecture will share practical lessons learned from building fully open models, covering the end-to-end process from pretraining on trillions of tokens to post-training with reinforcement learning.
Contrasting with the "rosy retrospection" of published papers, the talk will delve into the messy reality of LLM training: 2 a.m. debugging sessions, sudden loss spikes, and subtle tensor-parallelism bugs that sabotage runs—real details that never make it into final papers.
More from Companies & People
- Bloomberg chart: China closes AI gap, price war pressures US labs — Hesamation · 2026-08-20
- Uber launches Baidu's driverless Apollo Go robotaxis in Dubai starting Aug 20 — Baidu_Inc · 2026-08-20
- Travis Kalanick returns with Atoms, backed by Ben Horowitz's biggest-ever check — rohanpaul_ai · 2026-08-20
- OpenAI Builds Zero-Storage Safety System to Detect Misuse — The Decoder · 2026-08-20
- Uber Partners with Zipline for 1M Daily Drone Deliveries by 2029 — lukas_m_ziegler · 2026-08-20
- Compliance is the key to unlocking big-ticket enterprise AI deals — santoshpanda · 2026-08-20