Survey: most self-improving agents only tune prompts and tools, rarely weights
maier_ak · x · 2026-09-22
A survey from Jürgen Schmidhuber's group finds most self-improving agents only tweak the fast scaffold — prompts, memory, tools — while keeping model weights frozen. Genuine weight updates are rare and risk collapse. Future work targets test-time adaptation and budget-aware improvement.
It also proposes logging self-improvement as checkpointed performance curves under a fixed update budget.
More from AGI Musings
- Turing winner Whitfield Diffie: 'I'm concerned by your obsession with IP' at AI-math panel — thoefler · 2026-09-22
- ScienceBuddy-Jev answers plant biochem question in 0.62s at 99.97% confidence — Scobleizer · 2026-09-22
- Hassabis: AGI's big questions belong to the arts, full AGI years away — victor_explore · 2026-09-22
- Meta researcher: AI progress is like Moore's law — long run, but it ends — rbhar90 · 2026-09-22
- Tesla FSD vet: chasing bar charts has hollowed out LLM development — yunta_tsai · 2026-09-22
- Reddit debates an unusual AI trend chart: where does this curve end up? — wrcromagnum · 2026-09-22