Who First Saw Linear Mode Connectivity? Vaishnavh's Test-Loss Observation Predates the 2019 Paper
roydanroy · x · 2026-09-29
Roydanroy clarifies the history of linear mode connectivity (LMC): the first observation was by @vaishnavh, on test loss when swapping training data—predating Frankle and Dziugaite et al. 2019, which coined the term and defined LMC on train loss (IIUC), though his team also observed it on test and believes it appeared in the abstract.
He calls LMC one of the most underrated features of training neural networks, noting lots of cool follow-up work since.
Related event: Linear Mode Connectivity Sparks Debate Over Its Origins(2 posts)→
More from Research
- WebArena-Pro: a 300-task multimodal benchmark across 20 self-hosted apps for web agents — McGill-NLP · 2026-11-16
- DySENSE: MIT's GenAI framework synthesizes satellite imagery with dynamic city energy maps — MIT · 2026-11-16
- Continual-ARC: lifelong ARC-AGI stream finds agent harness persistence rarely beats simple caching — unifyai · 2026-11-16
- Most VLAs lose their VLM's vision-language skills during pretraining — DJiafei · 2026-11-16
- Training-free page-sparse decode in llama.cpp: 1.72× faster 128k decoding on an RTX 5090 — topppggg · 2026-11-16
- Training Qwen3-8B to drive a simulated hand spawns a dedicated internal 'pressure' direction — repligate · 2026-11-16