brandondamos: numerical divergence bugs likely lurk in other objectives; 2008 JSD paper resurfaces
brandondamos · x · 2026-11-17
Researcher brandondamos notes that the numerical cancellation issues found near-equality divergences likely lurk in other optimization objectives too. He surfaced a 2008 technical report (arXiv:0810.5117) deriving a non-negative series expansion for the Jensen-Shannon divergence when distributions are nearly equal. The thread also flags related numerical hazards in f-divergences, Bregman divergences, Sinkhorn divergences, and differentiable DTW.
Related event: Numerical Pitfalls Near Equal Points in Divergence Computation Resurface(2 posts)→
More from Research
- Google DeepMind unveils Gemini 4 Carbon for physics, math and life science research — GoogleDeepMind · 2026-11-17
- Gemini 4 Carbon proves Signal crypto security in weeks, finds 40x more protein sequences — GoogleDeepMind · 2026-11-17
- Frame-by-frame real gradient descent: α=0.6 zigzags the valley, α=0.3 glides down — ZeroStateReflex · 2026-11-17
- Data Scientist Distills 2 Years of Bayesian Statistics Lessons Into a 2-Minute Primer — mdancho84 · 2026-11-17
- 'Formalizing All Math' went from absurd to consensus in 8 months; CFSG audit found 96 paper errors — AlexKontorovich · 2026-11-17
- Chest X-ray AI flags high fracture risk in 53k-patient NEJM AI study — zakkohane · 2026-11-17