DeepMind's Andrew Trask: Scaling Laws Are Pushing AI From Monolithic Models to Protocols
iamtrask · x · 2026-07-30
DeepMind's Andrew Trask discusses how scaling laws are reshaping the future architecture of AI. He notes that as single companies hit bottlenecks in data, compute, and talent, AI is evolving from a massive monolithic "program" into a "protocol."
By combining models from multiple providers, we implicitly integrate the resources they were trained on, yielding faster and better models at lower costs. Trask emphasizes that ensembling top-tier models will always win for absolute accuracy, while mixing open and closed models will quietly dominate the Pareto frontier for price-to-performance ratio.
More from AGI Musings
- Duke Study of 4,439 People Finds Coworkers Quietly Rate AI Users as Lazier — aakashgupta · 2026-10-16
- DSPy Author's $70 O'Reilly Book Rejected by Engineer Who Now Just Tells Claude What to Do — lateinteraction · 2026-10-16
- 'A machine proving new math, a car driving up a wall': AI researcher on how weird it's getting — rand_longevity · 2026-10-16
- Yacine on training: 'Neural nets are lazy stupid idiots — I build hells to make them ubermensch' — yacineMTB · 2026-10-16
- Jeff Clune: Moving the Goalposts Will Be Humanity's Last Job — jeffclune · 2026-10-16
- Replit CEO Amjad Masad Says the Future of Work Is the 'Self-Driving Company' — TechCrunch AI · 2026-10-16