MIT's Ziming Liu: AutoResearch doesn't generalize — blind training tricks cause 'forking' disasters
ZimingLiu11 · x · 2026-10-26
Ziming Liu, MIT researcher and KAN author, argues that AutoResearch doesn't generalize: training tricks found by automated search lead to an overfitting disaster he calls "forking" under small changes in settings. Without mechanistic understanding, he says, "we're just worshiping its shit" — human researchers' real value is digging into the mess and explaining why it happens. A pointed critique of the current automated-research hype.
More from AGI Musings
- Goldman finds statistically significant negative link between AI adoption and US employment growth — ben_j_todd · 2026-10-27
- a16z: World-changing tech makes a chaotic entrance — AI agents are following the same path — a16z · 2026-10-27
- NEJM AI on medical education: mastery requires performing without the machine — BraydonDymm · 2026-10-27
- Dev warns abliterated models could wreck software supply chains with 1000+ transitive dependencies — nitarshan · 2026-10-27
- Delete your priors: why every SOTA model drop should reset how you think the world works — zack_overflow · 2026-10-27
- Replit predicts every Fortune 500 will be a 'Self-Driving Company' by end of 2030 — amasad · 2026-10-27