GPU Power Limiting for Better Energy Efficiency Tested
apollo_mg · reddit · 2026-07-17
The author shared empirical results of frequency/power tuning on a P100 GPU, aiming not for peak throughput, but to maximize tokens/joule.
Key points:
- By running nvidia-smi -pm 1 -ac 715,1063, the speed dropped to about 84% of the original, power consumption was reduced to 67%, and energy efficiency improved by roughly 25%.
- After setting -pl 150, the performance hit was negligible for this workload, with a loss of about 0.3%.
- The author emphasizes: squeezing out the last bit of frequency often comes at a massive power cost; moderately lowering the speed is actually more cost-effective.
This is a practical case study in compute energy saving/efficiency optimization, useful for inference deployment and GPU operations reference.
More from Infra
- Nature Physics: reprogrammable refractive index enables arbitrary multimode wave control for ML — MarioKrenn6240 · 2026-10-27
- RTX Spark laptops impress analyst: 30B local model runs quiet with great battery life — Scobleizer · 2026-10-27
- Reflection AI's Beam-1.0 tops US open-weight models, hitting 88% of Qwen3.8-2.4T with 23B active params — ryanshrout · 2026-10-27
- Re-uploading a 239GB robot dataset moved only 2.6MB — inside a petabyte-scale data pipeline — mervenoyann · 2026-10-27
- Intel to acquire Classiq to build full-stack quantum computing platform — BenBajarin · 2026-10-27
- Ant's own data centers and models on in-house inference silicon will boost margins — BenBajarin · 2026-10-27