Is LogSumExp Optimal? A Peer-Reviewed Answer in the Journal of Complexity

prof_grimmer · x · 2026-11-18

profgrimmer and student Thabo Samakhoana investigated softmax/LogSumExp smoothing — the de facto standard across ML and optimization — asking in what sense the choice is "optimal". They found elementary answers, with both good and bad news, published in the Journal of Complexity. The author praises peer review for challenging and maturing the work, and shares how the paper grew from its initial version.

Original post →

More from Research

Research channel →