New paper detects overfitting directly from weight matrices without any data
burny_tech · x · 2026-09-20
- The WeightWatcher paper 'Late-Stage Generalization Collapse in Grokking: Detecting Anti-Grokking with WeightWatcher' shows you can detect overfitting signatures directly in layer weight matrices, without access to any train or test data.
- Demonstrated explicitly in two classic grokking experiments, revealing a form of late-stage overfitting different from what has been seen before.
- The authors track the Grokking → Stability → Anti-Grokking trajectory and have submitted the work to ICLR.
More from Research
- ICLR 2027 Tops 60,000 Submissions as Author Proposes an AI-Reviewed Fast Track — PTenigma · 2026-09-20
- 9.9K-star GitHub repo trains an LLM from scratch in plain PyTorch, pretraining to GRPO — techNmak · 2026-09-20
- Judea Pearl: students should learn causation before statistics — yudapearl · 2026-09-20
- Paper Mill Studies Cited in 480 Patents and Clinical Guidelines, Analysis Finds — nicklaslundblad · 2026-09-20
- Real-time coastal simulation in Three.js pairs shallow-water solver with breaking swells, code open-sourced — techartist_ · 2026-09-20
- Nature paper demonstrates a thermodynamically favoured Scaffolded DNA Computer running 10 programs — chaitjo · 2026-09-20