A Live Open LLM Pretrain and RL Training Run You Can Watch in Real Time
mariofilhoml · x · 2026-09-19
The author highlights a practical talk on pre-training LLMs and points to an unusually transparent effort: an LLM pre-training run and an RL training run are both happening in the open, live, right now, with a public link to follow along. Watching a full pretrain + RL pipeline unfold in real time is a rare learning opportunity for researchers and practitioners.
More from Models
- ChatGPT Pro 20x plan back on sale after OpenAI's capacity pause — mark_k · 2026-09-19
- OrukLabs launches Resonance-2 with 31 emotion and speaking-style signals from audio — ChrisGPotts · 2026-09-19
- OpenAI launches Astra for Law; lawyer slams ZDR privacy promises as unverifiable — bgmshana · 2026-09-19
- Noam's Actual Quote: Multi-agent Credited Less Than 10% for Math Breakthrough — eliebakouch · 2026-09-19
- LLM logprobs as soft classifiers: a year-old idea finally validated — JnBrymn · 2026-09-19
- Jev benchmarks: matches production classifiers on fixed-label tasks at ~100x lower cost — ivan_bezdomny · 2026-09-19