Optimizer Formulas Born on Whiteboard: Useful for Noisy or Low-Rank Gradients
HessianFree · x · 2026-09-01
Researchers recall the origin of optimizer formulas, noting they were developed on a whiteboard with Xilin and may help with noisy or low-rank gradients.
More from Research
- Daphne Koller: AI won't cure disease soon, human biology understanding is the bottleneck — pmddomingos · 2026-09-01
- Asymmetric Actor-Critic criticized for blocking gradients and causing robot gait issues — yacineMTB · 2026-09-01
- Gait Training Tip: Use Rolling Avg Velocity Reward — yacineMTB · 2026-09-01
- TMLR Emphasizes Clear Writing in New Acceptance Criteria — Aaroth · 2026-09-01
- Chollet debunks "100% on ARC-AGI-3" claim: only on easy public set — fchollet · 2026-09-01
- Author Clarifies AI Detection Study Tests Pangram — TuhinChakr · 2026-09-01