Deep Dive with Yulu Gan on How Pretraining Shapes Weight Distributions
yacinelearning · x · 2026-08-13
Recommend a 1h12min discussion with Yulu Gan covering weight distribution landscapes for small models, big models, and distilled models, offering deeper intuition on pretraining's effects.
More from Research
- NeurIPS 2026 MATH-AI Workshop Calls for Papers on Agentic AI and Math — KaiyuYang4 · 2026-08-13
- Automating AI Research: A Retrospective on Breaking World Records — tensorqt · 2026-08-13
- A Mathematical Model for Non-Violent Propaganda: Quantifying Emotional Manipulation in Networks — andrew_n_carr · 2026-08-13
- Four architecture choices can cost up to 47% of long-context performance; new study releases OlmPool — dair_ai · 2026-08-13
- Recast Systems Exits Stealth with Hyper-Resolution AI Weather Model — hudzah · 2026-08-13
- Survey: How long does it take to implement an ML paper with AI coding assistants? — Secret-Boss7472 · 2026-08-13