"Slowest pretrain I've ever supervised": researcher's one-line lament
cephaloform · x · 2026-10-19
X user cephaloform, who supervises pretraining runs, posted: "this is the slowest pretrain i've ever had the displeasure of supervising." A single line, but first-hand grumbling about a slow pretraining run — often read as circumstantial evidence of tight compute supply, though it may just be one project's scheduling issue.
More from Infra
- Owning vs renting vs API for inference comes down to GPU utilization — Milan_Slov26 · 2026-10-19
- Anthropic signed 57% of this year's $157B in neocloud deals, dwarfing OpenAI — AccBalanced · 2026-10-19
- Open decision model D3 tops Jev Index, ships vLLM recipes from 0.6B to 27B — AccBalanced · 2026-10-19
- 2-GPU R9700 vLLM rig hard power-offs: tensor-parallel all-reduce transient, not wattage, kills 1200W PSUs — brainchillzZ · 2026-10-19
- AI performance engineering meetup: GPU rooflines, agent trace-to-training loop, Homa transport — cfregly · 2026-10-19
- Ultra Ethernet Spec 1.1 Lands With Scale-Up Networking and In-Network Computing — thoefler · 2026-10-19