Automating AI Without Fine-Tuning: 6 Techniques That Broke a 56-Year Math Record
theomitsa · x · 2026-08-02
Researchers summarized 6 techniques to automatically improve AI systems without fine-tuning weights or manual intervention. They all share a basic loop: an LLM proposes a change, an evaluator scores it, and only improvements are kept.
They differ in what they edit (text, prompt, code, or training loop) and how they judge it. Results are striking: one method broke a 56-year-old math record, and another beat RL using 35x fewer rollouts.
More from Research
- Netflix details its production LLM judge: hundreds of thousands of recommendations scored weekly — omarsar0 · 2026-08-24
- Nature Comment: Provenance, not interpretability, grounds trust in autonomous science — gabepgomes · 2026-08-24
- New Architecture RHEA: Train 1B Model on 8GB VRAM — zemondza · 2026-08-24
- Trained two 16M-param models to do generative CAD with real physics — debreuil · 2026-08-24
- Claude model helps discover complex structure on S^6, solving 60-year-old math problem — Singularitarian · 2026-08-24
- Study: Agents read instructions/notes 60.5% of the time, rarely touch API docs — dair_ai · 2026-08-24