brandondamos: numerical divergence bugs likely lurk in other objectives; 2008 JSD paper resurfaces

brandondamos · x · 2026-11-17

Researcher brandondamos notes that the numerical cancellation issues found near-equality divergences likely lurk in other optimization objectives too. He surfaced a 2008 technical report (arXiv:0810.5117) deriving a non-negative series expansion for the Jensen-Shannon divergence when distributions are nearly equal. The thread also flags related numerical hazards in f-divergences, Bregman divergences, Sinkhorn divergences, and differentiable DTW.

Related event: Numerical Pitfalls Near Equal Points in Divergence Computation Resurface(2 posts)→

Original post →

More from Research

Research channel →