oecolamp concedes: during the H100-only era, software gains mattered a lot
oecolamp · x · 2026-10-07
oecolamp responds to JoshPurtell: in equilibrium, big hardware shifts absorb most science/engineering effort (e.g. training bigger models), masking software contributions. But he concedes a counterexample—during the period when everyone mostly had H100s, software improvement helped a lot.
More from AGI Musings
- What Three-Body Problem's longtermism teaches about facing an ASI-level threat — JacquesThibs · 2026-10-08
- COLM'26: MathDuels self-play benchmark co-evolves difficulty across 19 frontier models — AI4Code · 2026-10-08
- OpenAI releases new math results from frontier model as mathematicians 'grieve' — TheTuringPost · 2026-10-08
- eigenrobot debates EA forecasting: quantitative beats vague "I'm unsure" — eigenrobot · 2026-10-08
- OpenAI math results push LLMs toward 4 of 7 Millennium Prize problems, and one VC says AGI is here — deedydas · 2026-10-08
- Gary Marcus Slams OpenAI's Vague Math Proof Report: Zero Details, Won't Pass Peer Review — GaryMarcus · 2026-10-08