Quantized code LLMs measured by energy per solved task: 7B-q2_K costs 2x

Aditi Patodiya · hf · 2026-11-20

The author ran 24 GGUF files of Qwen2.5-Coder at four sizes on a fanless MacBook Air M2, pricing each by energy per solved task across 542 EvalPlus tasks, yielding a selection guide indexed by Ollama's listed file size.

Key findings

Per-task results, power logs and the analysis script are released.

Original post →

More from Infra

Infra channel →