Scratch to Scale: Hands-On HPC LLM Training Course Opens With Dedicated GPUs
TheZachMueller · x · 2026-08-21
Zach Mueller's "Scratch to Scale: Real-World HPC Training" course is open for enrollment. Beyond basics (DDP, ZeRO-2), it dives into expert parallelism, context parallelism and 3D parallelism taught from scratch. A dedicated compute cluster (thanks to Lambda) is provided: a limited cohort of up to 64 students, each with at least 2 dedicated GPUs for the full 6 weeks, with full nodes for teams of 4, bigger projects and tougher homework.
More from Companies & People
- UK AI Security Institute Names Nate Burnikell as Chief Strategy Officer — geoffreyirving · 2026-08-21
- AI practitioner shares: Getting stronger yet lazier, still trusts human reviews — vista8 · 2026-08-21
- Remote Co-founder Builds Agent Icarus to Automate Tacit Company Knowledge — dscape · 2026-08-21
- Analyzing AGENTS.md in Top 100 Repos: Strict Rules and 'Don't Claim Timed-out Tests Passed' — ohansemmanuel · 2026-08-21
- Fu Sheng: CEOs must use AI personally to avoid 'AI Psychosis' — FuSheng_0306 · 2026-08-21
- Leak: Google is the mystery hyperscaler behind Modine's $4B deal — citrini · 2026-08-21