'No emergent properties, it's all in the data': the bitter lesson debate reignites
KyleMorgenstein · x · 2026-09-14
In a quoted post, aliteracy argues for 'another bitter lesson: there are no emergent properties, it's all in the data' — and adds that what actually makes modern LLMs work isn't aligned with Sutton's original bitter lesson (scale of compute and learning), but the data itself. A pointed take in the ongoing debate over whether emergent abilities are real.
More from Research
- KAIST Proposes PLC-DPO to Correct Noisy Preference Labels via Posterior Margins — kaist-ai · 2026-09-14
- Tencent Hunyuan Open-Sources SAS: End-to-End Sparse Attention via Context Ranking — Tencent-Hunyuan · 2026-09-14
- NUS releases LIT to break vision-action shortcuts in robot foundation models — NationalUniversityofSingapore · 2026-09-14
- CUHK-SZ's COBRA-Skills: contextual bandit-guided skill evolution for LLM agents — CUHKSZ · 2026-09-14
- Code-graph retrieval cuts tokens 75-82% vs grep, but its benchmark skips accuracy — coding-os · 2026-09-14
- PhD student wants AI to analyze 169 ovarian slides after Nature Aging paper read 1,112 across 7 organs — anantm · 2026-09-14