Cosine on Building Sovereign Frontier Models
Machine Learning Street Talk · rss · 2026-07-14
This interview explores why Cosine is building a "domestic/sovereign frontier AI." The core context: the UK's strongest coding model cannot be exported, prompting Cosine to build its own models and systems from scratch.
Key takeaways from the interview:
- The company believes that an inference-focused company doesn't necessarily need billions of dollars in training lab investments; a few million, national-level compute quotas, and coordinated feedback loops can also work
- A discussion on why open-weight models still lag behind frontier models, particularly regarding scale, active parameters, and data
- An explanation of the trade-offs between MoE vs dense, and why active params noticeably affect a model's "feel"
- The second half focuses on agent usability: rewarding the process rather than the outcome, turning code review into runtime verification, orchestrating hundreds of sub-agents using Swarm, and how memory remains an unsolved challenge
- Mentions of US export controls, supply chain risks, and how synthetic scorers can support RL tasks without built-in tests
More from Companies & People
- This Week in AI Healthcare: Open Source Models, Anthropic Partners with Largest Healthcare Company — HealthcareAIGuy · 2026-07-21
- NBER talk will present new evidence on how organizations use ChatGPT — daveholtz · 2026-07-21
- Tesla expands Grok in-car assistant to five Asian markets — XFreeze · 2026-07-21
- Déjà View looks up earlier startups for any idea and how they ended — Sea-Assignment6371 · 2026-07-21
- A Hugging Face researcher says audience building came from open source, teaching, and depth — mervenoyann · 2026-07-21
- AI may push resistant tech workers toward union bargaining — Chobeat · 2026-07-21