Pedro Domingos: Minimizing Cross-Entropy Is Not Maximizing Compression
pmddomingos · x · 2026-09-02
UW professor Pedro Domingos asserts that minimizing cross-entropy in LLMs does not maximize compression, calling contrary views a "pernicious misunderstanding." This is part of a technical debate with Google DeepMind researcher Christian Szegedy regarding model compression and likelihood.
More from Research
- Arena Physica releases Heaviside-1 foundation model for electromagnetism — seanmcdonaldxyz · 2026-09-02
- Researcher joins Anthropic's AI for Science program, opens source literature analysis platform — melnykowycz · 2026-09-02
- Paper Shows On-Policy Distillation Gains Come from Self-Improvement, Not Teacher Guidance — _akhaliq · 2026-09-02
- The World Labs Introduces Atlas: Pixel-Perfect Camera Control World Model — Scobleizer · 2026-09-02
- 4DAnyone on Gradio: Optimized for <32GB VRAM, 8x Faster — _akhaliq · 2026-09-02
- Meta's Muse Voice Transcribe Balances Speed and Accuracy with Adaptive Delay — AIatMeta · 2026-09-02