GPU Thermal Throttling Slashes LLM Benchmark Throughput 31% on a GTX 1650
the-random-guy-2002 · reddit · 2026-11-03
A Redditor benchmarking KV caching baselines on a GTX 1650 saw repeated 512-token generations degrade from 2.77s to 4.04s (185 → 127 tokens/sec, a 31% drop) as GPU temps hit 84–87°C and clocks dropped. Cooled runs consistently returned to 2.77s — a concrete reminder that thermal conditions matter when comparing inference optimizations.
More from Infra
- Google's Suncatcher satellite runs Gemma 270mi n space—power limits mean only one TPU lit at a time — demian_ai · 2026-11-03
- Mistral VP: Le Chonk trained on just 10 MW (~4,000 H100s), begs investors for 1 gigawatt — _AndrewZhao · 2026-11-03
- UCSB awards IEE seed funding to three ECE projects on energy-efficient AI and quantum hardware — ninamiolane · 2026-11-03
- Europe's Physical AI Agenda: Gigafactories, Sovereign Compute and AI Act Rules — ingliguori · 2026-11-03
- Weight teleportation open-sourced: cross-datacenter RL weight updates under 0.23s — gharik · 2026-11-03
- YouTuber's "F-You to Sam Altman" video showcases a local AI GPU rig — unchikuso · 2026-11-03