Researchers Discuss Fitting and Parameter Selection in Scaling Laws

Researchers discussed the application of scaling laws in training large models, sharing methods for fitting scaling laws via grid measurements. Alex Dimakis clarified the debate between Chinchilla and Kaplan, noting that Chinchilla correctly proved parameters and data should scale linearly.

2026-07-05 ~ 2026-07-06 · 4 related posts