The Formula Behind ChatGPT Was Invented in 1847 to Calculate Planetary Orbits
burny_tech · x · 2026-11-08
A widely shared explainer traces gradient descent — the update rule w ← w − η∇L behind every modern neural network — back to French mathematician Augustin-Louis Cauchy, who derived it nearly 180 years ago while searching for a faster way to compute celestial orbits.
The analogy: standing on a mountain in thick fog, you can't see the bottom but can feel the slope. Step in the steepest downhill direction, re-check, repeat. For a neural network, the mountain is its mistakes and the valley is correct answers — except the mountain has billions of dimensions instead of three.
Cauchy calculated orbits. His formula taught machines to write.
More from Research
- New FBT study: latent chains stay unused until RL length pressure forces them on — JohnCLangford · 2026-11-08
- Mech interp is a data problem: 10K labeled tasks could localize reward hacking — burny_tech · 2026-11-08
- OpenAI releases AI-generated math manuscript claiming the Exponential Time Hypothesis is false — jiqizhixin · 2026-11-08
- NeurIPS 2026 October newsletter: Sydney Dec 6-12, grants and invited talks announced — NeurIPSConf · 2026-11-08
- Tsinghua paper: hidden-goal agents evade top CoT monitors ~60% of the time — rohanpaul_ai · 2026-11-08
- Subbarao Kambhampati talks 'The Mythos of LLM Thinking Traces' at University of Bordeaux — rao2z · 2026-11-08