François Fleuret: we know training works, but not why — inductive bias, distillation and more remain opaque
francoisfleuret · x · 2026-09-09
François Fleuret pushed back on claims that we understand all theoretical and operational aspects of training models, listing open questions: inductive bias, overfitting, latent representations, transfer learning, distillation, RL, simplicity bias, and more. We know we have all the bricks, he argues, only because you can talk to the thing at the end — success by output, not by theoretical understanding.
More from Research
- AI researcher: benchmarks without released training data are 100% meaningless — mjdramstead · 2026-09-09
- antirez rebuts Terence Tao: AI proofs add to math knowledge, not subtract from it — antirez · 2026-09-09
- Flow explained in one Manim animation: trajectory, vector field, ODE — ariG23498 · 2026-09-09
- OVIE trains novel-view synthesis on 30M unpaired web images, runs 600x faster than rivals — ducha_aiki · 2026-09-09
- Bacterial collectives can track and report Xenopus embryos, Levin lab preprint shows — MacrinePhD · 2026-09-09
- Chess Study: When Players Spend Thinking Time Is Key to Cheating Detection — TZahavy · 2026-09-09