AI task energy use falls ~10x per year, yet data center power still jumped 50%: IEA
import_jmr · x · 2026-08-14
Per the IEA's latest report, energy use per AI task is falling roughly 10x a year — faster than almost anything in energy history. The gains come from real architecture research: better embeddings, small domain-adapted models, smarter attention and more efficient chips; Gemini Encoder-Heavy and Embedding run the same task orders of magnitude more efficiently at equal or better quality.
Yet the efficiency dividend doesn't shrink the bill: electricity use from AI data centers still rose 50% last year. A simple text query uses about 0.05 Wh, while an agentic task that reasons and calls tools can use 50. Every efficiency gain gets spent on heavier workloads — reasoning, agents, video — with task complexity outpacing efficiency gains. Breaking the loop, the author argues, takes a real shift in how AI software and hardware are built, from new model architectures to neuromorphic chips and quantum computing.
More from Infra
- Qwen3.8-27B-FP8 on GH200: 10 concurrent streaming requests, first token in 10ms — MaziyarPanahi · 2026-08-15
- Qwen3.8-27B Serving Configs: DGX Spark vLLM and RTX 4090 llama.cpp — erdaltoprak · 2026-08-15
- AI video billing metered by pixel area, not duration: developer warns to reconcile invoices — DryProgress9179 · 2026-08-15
- Analyst: Memory Cycle Structural, Sentiment Should Shift — BenBajarin · 2026-08-15
- Attention-FFN disaggregation: a new direction for inference speedups? — tokenbender · 2026-08-14
- DeepSeek-V4-Pro launches: 1.6T-param MoE cuts inference FLOPs to 27% of V3.2 — AccBalanced · 2026-08-14