COLM 2026 workshop targets predictive science of foundation models, Wilson to speak
andrewgwils · x · 2026-10-09
Andrew Wilson will speak and panel at the "Scientific Understanding of Foundation Models" workshop at COLM 2026 (Oct 9, San Francisco), arguing our grasp of generalization and scaling laws is better than commonly believed. The workshop aims to move from empirical scaling phenomena toward predictive, testable science: limits of scaling laws, when data curation beats scale, and how much pre-training structure post-training actually uses.
Related event: COLM 2026 to Host Workshop on Scientific Understanding of Foundation Models(2 posts)→
More from Research
- Meta AI: Mid-training LLM on raw video lifts multimodal scores without text loss — kastnerkyle · 2026-10-10
- Hybrid Architectures Rising: NVIDIA Nemotron-H Is Mostly Mamba With Minor Attention — khademinori · 2026-10-10
- DiPOD stabilizes diffusion LM post-training, lifting Sudoku accuracy from 22% to 97% with a one-line change — berkeley_ai · 2026-10-10
- Pretraining efficiency gains come mostly from data, but end-to-end task gains spread across RL and systems — eigenron · 2026-10-10
- Strong backbones plus light fine-tuning beat synthetic data, says researcher whose model tops benchmarks — antoine_chaffin · 2026-10-10
- Simulator + lab-in-the-loop is the standard for protein optimization, says Kidger — PatrickKidger · 2026-10-10