NVIDIA's Catanzaro: Planning to Release Stronger Internal Teacher Models
Dan_Jeffries1 · x · 2026-08-24
Bryan Catanzaro, Head of Nemotron at NVIDIA, revealed that the company has internal "teacher" models that beat everything it has publicly shipped and he is trying to release them via the Nemotron project. Key points:
- Internal Models: NVIDIA possesses a collection of teacher models individually better at different domains than any released model.
- Distillation Tech: Using teacher models and multi-domain on-policy distillation has been key.
- Open Source Strategy: Open source is good business for NVIDIA. Nemotron is an open technology effort including datasets and techniques. Further AI development and deployment create business opportunities for NVIDIA, motivating them to grow the ecosystem.
More from Companies & People
- UMD Philosophy hires: junior Philosophy of Mind and joint AI Ethics/Safety positions — sethlazar · 2026-10-16
- NVIDIA makes 7 AI agent courses free, from agent basics to securing agents — ifioknkem · 2026-10-16
- Meta researcher Jesse Dodge named among DASCIN's Green IT Top Leaders of 2026 — JesseDodge · 2026-10-16
- ROBIB Meetup #3 returns to Ghent on Nov 19 with Physical AI talks, demos and panel — MarwaEldiwiny · 2026-10-16
- Google publishes its September 2026 AI updates roundup — OnlineInference · 2026-10-16
- Snowflake's FDE team uses three questions to decide which customer projects to scope in — ivory_tang · 2026-10-16