Danielle Fong: half of progress work is interfacing with human civilization — and we're bad at it
DanielleFong · x · 2026-11-08
Danielle Fong argues that more than half of progress work is interfacing with human civilization—the part we're worst at. Simplified models of progress will eventually run out of usefulness and must become multi-dimensional, especially as AI itself runs on trillions of parameters. Anders Sandberg's quoted reply explains why he avoided bottleneck-structured models: Amdahl's law is a powerful slowdown factor but invisible in early exponentials.
Related event: Sandberg and Fong Debate How to Model Progress(4 posts)→
More from AGI Musings
- JEV Gets Its First Paper as Researchers Split on Research Merit vs Closed Business Model — teortaxesTex · 2026-11-08
- "Humans overfit to confirmation too" — a witty mode collapse analogy for AI slop debate — flowersslop · 2026-11-08
- bayeslord: Stop treating AI as a monolith — four distinct goals demand precise language — sebkrier · 2026-11-08
- AI doesn't change how unique your niche interests are, argues dev pixlpa — pixlpa · 2026-11-08
- Albert Gu: Bitter Lesson isn't 'just scale Transformers' — algorithmic innovation matters — sewon__min · 2026-11-08
- The 'evolutionary mismatch' chart explaining why humanity will ignore AI warnings — sebpaquet · 2026-11-08