Yacine Questions: How is Model Distillation Possible Without Logits Access?
andganna · x · 2026-07-23
Amid recent industry debates over "model distillation," Yacine tweeted a core question: how are third parties technically achieving distillation when APIs are strictly closed and do not expose logits? He questioned if the meaning of the term has shifted to simply mean "using our AI models to write code."
More from Models
- Peter Diamandis says enterprise in-house models could reset top lab valuations — PeterDiamandis · 2026-07-23
- Quoted slide says multimodality is important, but not the core of intelligence — zephyr_z9 · 2026-07-23
- An open-source model may have overtaken Google’s unreleased Gemini 3.5 Pro — ChrisGPT · 2026-07-23
- ChatGPT Pro vs. Claude Max: which $100 plan yields more weekly work for heavy dev use? — Haunting-Stretch8069 · 2026-07-23
- OpenRouter Data Shows Gemini Becomes the API Market Leader — PsychicorAI · 2026-07-23
- MiniMax M3 weights use a community license, not MIT or Apache — SprinklesLeather7515 · 2026-07-23