CS224n week 1 maps NLP's four eras, from rules and stats to scaling and Shannon
stanfordnlp · x · 2026-10-12
A CS224n student summarizes week one: NLP has gone through four eras — rules lost to statistics, statistics lost to scaling, vindicating Sutton's Bitter Lesson.
Re-reading Shannon's 1948 paper after class, the noisy channel model still underlies machine translation; the post's images include the 1954 Georgetown-IBM machine translation demo coverage and Shannon's noisy channel diagram. It also notes Anthropic named Claude after Shannon.
More from Companies & People
- Katzenberg and ex-Sora lead Bill Peebles' stealth startup in talks with OpenAI to sell Sora to studios — steph_palazzolo · 2026-10-12
- Anthropic chief economist joins Jason Furman at Harvard to discuss AI's economic impact — HarrySurden · 2026-10-12
- Google has the most direct access to Gmail and Calendar, yet is far behind in personal agents — altryne · 2026-10-12
- User says Claude charged his card, demanded government ID, then blocked him — EfficientOrdinary659 · 2026-10-12
- Redis creator antirez: AI could bring much of the IT industry back to Europe — antirez · 2026-10-12
- China's AI education apps hit 120M monthly users amid nationwide rollout — CurieuxExplorer · 2026-10-12