Major Update to 'The Elements of Differentiable Programming' Released

mblondel_ml · x · 2026-08-06

The author announced a major update to their book, The Elements of Differentiable Programming, featuring a comprehensive proofread assisted by Gemini.

The book treats differentiable programming as an emerging paradigm, exploring how to achieve end-to-end differentiation of complex computer programs, including those with control flows and data structures, enabling gradient-based optimization. It synthesizes fundamental concepts from automatic differentiation, graphical models, optimization, and statistics. The content is structured around two main perspectives: optimization and probability, highlighting clear analogies between the two. It emphasizes that differentiable programming is not just about differentiating programs, but about the thoughtful design of programs intended for differentiation.

Original post →

More from Research

Research channel →