ADANA thread: DANA theory says log-time memory outscales fixed memory with slope 2-kappa
_katieeverett · x · 2026-09-10
The thread explains the theoretical basis: DANA's theory on power-law random features predicts log-time memory outscales fixed memory with slope 2-κ, where κ is a data-distribution property measured at ≈0.85 for language data.
More from Research
- What makes research get adopted: important problems, proper evals, and usability — srchvrs · 2026-10-27
- Bitter lesson part 2: few academic inventions matter, and conference publications aren't the key — srchvrs · 2026-10-27
- The four criteria for research impact: important problems, strong baselines, scalability, real usability — srchvrs · 2026-10-27
- EMNLP keynote: industry does read academic NLP papers, it just rarely credits them — srchvrs · 2026-10-27
- Researcher says GitHub used his team's bit-packing work but credited only 1 of 3 authors — srchvrs · 2026-10-27
- First-week PhD student lands ARR Area Chair role, exposing peer-review quirks — anmarasovic · 2026-10-27