François Fleuret tells LeCun bit count is a poor proxy for information content
francoisfleuret · x · 2026-10-05
In an exchange with Yann LeCun, François Fleuret argues that the number of bits needed to encode data is a poor proxy for its actual information content.
His example: 4 hours of video of him slowly turning book pages contains few real bits despite its raw size. The reply came after LeCun challenged him with "what do you think I don't understand about information theory?" — a substantive technical dispute over measuring information in images and video.
Related event: LeCun Sparks Debate Over Whether Byte Count Measures Information(4 posts)→
More from Research
- Scientists open PRs on HF datasets: BIDS builder for neuroimaging and biosignals — evijit · 2026-11-20
- Hugging Hub science data formats mapped: AnnData leads genomics at 17% — evijit · 2026-11-20
- Fully AI-designed molecule Dyno-hc9: 7 mutations picked by deep learning, crosses blood-brain barrier — IAmSamFin · 2026-11-20
- Fine-tuned Qwen3-VL 8B reads camera shots at 69% accuracy, beating Opus and Gemini — ravisparikh · 2026-11-20
- Victor Taelin's Bend2 talk from SF Lean Meetup explains the rationale behind the language design — pbaylies · 2026-11-20
- Protocol Labs Launches Neuro Atlas: Companies, Milestones and BCI Funding Mapped — melnykowycz · 2026-11-20