Stanford CS329X HW1: hands-on instruction tuning, PPO/RLHF and DPO
EchoShao8899 · x · 2026-11-04
Stanford CS329X HW1 (Model Alignment and Human Feedback) has students implement classic LLM training algorithms—instruction tuning, PPO/RLHF, and DPO—plus hands-on preference annotation to appreciate how messy human feedback is. Google Colab provides free GPU/TPU access.
Related event: Stanford's New Human-Centered LLM Course CS329X Draws Surge in Enrollment(2 posts)→
More from Companies & People
- Google says it removed post-employment non-disparagement clauses from new-hire terms — HaydnBelfield · 2026-11-04
- Accenture Accused of Publishing AI Paper Littered with AI Hallucinations — nordicinst · 2026-11-04
- Sarvam hate debate: critics vs its from-scratch training, bulbul rollout, enterprise work — AashaySachdeva · 2026-11-04
- Baidu's Apollo Go wraps two-week public robotaxi test rides in Tung Chung, Hong Kong — Baidu_Inc · 2026-11-04
- Founder of 50-person, 12-country team says he talks to AI agents more than humans — Scobleizer · 2026-11-04
- Sam Altman teases next goal: 'closer to this milestone than I expected' — ChrisGPT · 2026-11-04