Cohere Talk on Reproducibility and Methodology in Scaling Laws Research
Cohere_Labs · x · 2026-09-02
Cohere Labs is hosting a talk on '(Mis)Fitting: A Survey of Scaling Laws' by Sneha Kudugunta. The session addresses the reproducibility of scaling laws used in foundation model training, highlighting how variations in fitting equations, training setups, and optimization methods lead to divergent conclusions. The talk surveys over 50 papers, noting that most lack crucial details for reproduction, and proposes a checklist for researchers to standardize reporting.
More from Research
- New paper shows Fiat-Shamir transformation breaks soundness for program-generated R1CS proof systems — jedisct1 · 2026-09-02
- TwinDEX: wearable co-designed grippers let a dexterous robot finish 20+ step chemistry lab with zero on-robot training — chris_j_paxton · 2026-09-02
- Cambridge team combines ML with conventional solvers for AC optimal power flow — lawrennd · 2026-09-02
- Sander Dieleman's 'Perspectives on Diffusion' resurfaces in flow matching debate — psuraj28 · 2026-09-02
- NUS researcher Xue Fuzhao: loop transformer ideas are cheap, careful execution is the AGI route — XueFz · 2026-09-02
- AITHYRA opens fully funded PhD call for AI × biomedical research in Vienna — LucaAmb · 2026-09-02