Cosine on Building Sovereign Frontier Models
Machine Learning Street Talk · rss · 2026-07-14
This interview explores why Cosine is building a "domestic/sovereign frontier AI." The core context: the UK's strongest coding model cannot be exported, prompting Cosine to build its own models and systems from scratch.
Key takeaways from the interview:
- The company believes that an inference-focused company doesn't necessarily need billions of dollars in training lab investments; a few million, national-level compute quotas, and coordinated feedback loops can also work
- A discussion on why open-weight models still lag behind frontier models, particularly regarding scale, active parameters, and data
- An explanation of the trade-offs between MoE vs dense, and why active params noticeably affect a model's "feel"
- The second half focuses on agent usability: rewarding the process rather than the outcome, turning code review into runtime verification, orchestrating hundreds of sub-agents using Swarm, and how memory remains an unsolved challenge
- Mentions of US export controls, supply chain risks, and how synthetic scorers can support RL tasks without built-in tests
More from Companies & People
- Anthropic mocked for warning of existential AI risk while pouring $750B into accelerating it — R4nsack · 2026-10-26
- Google expands paid News AI pilot to 400+ publications, adding CNN, FT, Axios, Forbes — thione · 2026-10-26
- Anthropic: junior tech hires fell from 27% to 9% as agent hours hit 6x employee hours — thione · 2026-10-26
- OpenAI to distribute frontier models and Codex through rival Google Cloud — thione · 2026-10-26
- Anthropic Believes Current Demand Is Only an Early Signal of What's Coming — cedric_chee · 2026-10-26
- Half the Fortune 500 Are Anthropic Customers Yet Spend Under 0.1% of Their Expenses — BenBajarin · 2026-10-26