"The Next 700 Bitter Lessons": the Bitter Lesson isn't done yet
rickasaurus · x · 2026-11-03
rickasaurus quips that there are still many bitter lessons yet to discover, suggesting someone should write a paper titled "The Next 700 Bitter Lessons" — riffing on Rich Sutton's classic essay, implying that compute-heavy general methods will keep beating hand-crafted approaches across new domains.
More from AGI Musings
- Security researcher: "no AI needed" breaches indict an industry stagnant for 20 years — chrisrohlf · 2026-11-04
- a16z partner: proof of agent is the 2020s version of GPU mining — adamamcbride · 2026-11-04
- Tuned harness beats the latest model: older GPT gains ~10 points untuned — VictorSanh · 2026-11-04
- What's missing from AI utopias: what the future actually feels like day to day — ryan_t_lowe · 2026-11-04
- Hot take: new AI methods are BS until someone runs them in prod three weeks later — generativist · 2026-11-04
- AI ethicist claims AGI lab leaders all privately believe the risk but stay silent — danfaggella · 2026-11-04