Agents spike AI energy use; local models save power
jonippolito · x · 2026-08-18
The author updated an AI carbon footprint calculator to compare energy usage across scenarios:
- Local vs Cloud: Cloud batching makes small models only 30% more energy-intensive than local ones, but local wins on water usage.
- Small Model Advantage: An 8B parameter model uses 0.3 Wh per paragraph, saving 10x compute compared to trillion-parameter frontier models.
- Agent Impact: When AI shifts from simple Q&A to autonomous agents, compute demand skyrockets, making the energy bill 'ugly'.
More from Infra
- NVIDIA and Perplexity Launch Portable Computer with Hybrid Agent Stack — ryanshrout · 2026-08-25
- Apple unveils M5 Ultra chip for 3D rendering and frontier AI models — Polymarket · 2026-08-25
- Qualcomm's new Snapdragon Oryon hits 5GHz with FlexCache for agentic workloads — ryanshrout · 2026-08-25
- Apple Silicon Still Leads Single-Threaded Performance — lemire · 2026-08-25
- Unsloth AI aims for day-zero llama.cpp support for Qwen models — danielhanchen · 2026-08-25
- DevOps to AI Infra is becoming a serious career path — _jaydeepkarale · 2026-08-25