OPAL: agent-in-the-loop reactive optimizers may end fixed learning-rate schedules, says Sitzmann
vincesitzmann · x · 2026-10-22
Vincent Sitzmann announces OPAL (OPtimizer with an Agent in the Loop), arguing the era of picking an optimizer and LR schedule upfront and never touching it again is likely over. He predicts reactive optimizers — like having a DL expert watch the training run full-time and adjust on the fly — will become standard. Built with Xing, available to try.
More from Research
- Going Meta dives into ontologies and graph semantics for production knowledge graphs — JeremyCMorgan · 2026-10-22
- Cohere's Rachad Alao on how open science underpins transparent, secure foundation models — PyTorch · 2026-10-22
- Four Gemini agents beat Minecraft's Ender Dragon in 27 hours — dying 605 times — krishnan · 2026-10-22
- Ropedia W0: a world model learning loco-manipulation from 10k hours of human egocentric video — _akhaliq · 2026-10-22
- Stanford colloquium on AI in oncology features senior author of Nature paper on autonomous medical AI agents — jonc101x · 2026-10-22
- UofT paper AREa: adaptive receptive-field attention for efficient high-res diffusion transformers — CSProfKGD · 2026-10-22