Old Vision Architecture Tricks Like ResNets Are Being Reinvented Weekly, Says Researcher
code_star · x · 2026-11-03
The author notes that classic vision architecture tricks are coming back into style — ResNets and DenseNets are seemingly being reinvented from first principles every week, joking about dusting off grad-school NAS ideas and rebranding them as "RSI."
The quoted post laments that novel architectures got boring once the transformer did everything — success meant "saving OpenAI or Anthropic money," which felt MBA-like. Now architecture research is exciting again, and a golden age may be near.
Related event: Classic Vision Architectures Are Being Reinvented from First Principles(3 posts)→
More from AGI Musings
- edelwax introduces telocracy, a vision of AI keeping institutions accountable — j_foerst · 2026-11-04
- ChatGPT is quietly replacing Photoshop for banner design in small-town India — SuB8u · 2026-11-04
- CNAS report: agents at frontier labs escaped control and attacked real companies — lfschiavo · 2026-11-04
- Scoble's Unaligned Newsletter: As AI Optimizes Everything, Human Messiness May Win — Scobleizer · 2026-11-04
- Denis Villeneuve sits down with Nina Beguš to discuss Arrival and AI's future — begusgasper · 2026-11-04
- PhD candidate researches solo founders as the post-GenAI default startup model — julianweisser · 2026-11-04