Signal65: token prices rise but cost per finished AI task stays flat as agent accuracy jumps
ryanshrout · x · 2026-09-12
Signal65's analysis on its PINNACLE benchmark pushes back on the "AI is getting more expensive" narrative: priced per finished task, costs are flat.
- Newest closed models finish 98%+ of multi-step enterprise jobs with few hallucinations
- Top PINNACLE score moved 3.6x in two weeks; top-tier cost per finished task rose only 11%
- GPT-6 lists at 2.5x GPT-5.6 but costs the same per finished job; Gemini 3.8 Flash makes 11x fewer errors than the best Gemma for 1.5x the cost
Bottom line: price per token went up, price of finished work did not — agentic capability is improving faster than pricing. The benchmark uses deterministic code-verified scoring, with NVIDIA Blackwell Ultra and AMD as platform partners.
Related event: Signal65's PINNACLE Benchmark: AI Cost Per Completed Task Hasn't Risen(2 posts)→
More from Models
- ARC Prize 2026 closes in 3 days as Yi-Chia Chen tops ARC-AGI-3 at 75.56% — GregKamradt · 2026-10-31
- Fable 5.5 Max stuns with gorgeous SVG of a pelican riding a bicycle, headed to Claude Code — ChrisGPT · 2026-10-31
- OpenAI reportedly to train on users' Daybreak sessions with no opt-out — dyn___ · 2026-10-31
- NVIDIA Nemotron 3.5 scales LLM self-verification, +9-10 points on agentic benchmarks — sarahcat21 · 2026-10-31
- Mistral Large 4 scores 94% on 1,273 USMLE-style questions but flips 44 at temp 0 — MaziyarPanahi · 2026-10-31
- Researchers find 5 personality structures in LLM weight space, Big Five-like — luke_drago_ · 2026-10-31