New optimizer without eig/inverse/solve by combining PSGD-Kron and KL-Shampoo
YouJiacheng · x · 2026-08-26
Researchers combined PSGD-Kron's multiplicative update and KL-Shampoo's KL objective to create an optimizer that avoids eigendecomposition, inversion, or solving linear systems. The method parametrizes $P=R.T@R$ and performs multiplicative updates by minimizing $KL(N(0, \Sigma), N(0, P^{-2}))$. The author noted the work was assisted by GPT Pro.
Related event: GPT Pro Combines PSGD-Kron and KL-Shampoo into Decomposition-Free Optimizer(4 posts)→
More from Research
- NTU to host IAS Frontiers Conference on Geometry, Dynamics, and Learning (GDL'26) — FrnkNlsn · 2026-08-26
- DeepSeek V4 Review: Frontier at CVE Finding, Weak on Hallucination — teortaxesTex · 2026-08-26
- GaussVid: Sparse-View Gaussian Splatting enhanced with 3D-Aware Video Diffusion Priors — zhenjun_zhao · 2026-08-26
- LagrangeGS models dynamic 3DGS as a non-conservative Lagrangian system — zhenjun_zhao · 2026-08-26
- Misanthrope: A Privacy-Preserving Keypoint Detector that avoids detecting people — zhenjun_zhao · 2026-08-26
- KLTNet: Learning-Based Sparse Feature Tracking for Improved Monocular VIO — zhenjun_zhao · 2026-08-26