Signal65: token prices rise but cost per finished AI task stays flat as agent accuracy jumps
ryanshrout · x · 2026-09-12
Signal65's analysis on its PINNACLE benchmark pushes back on the "AI is getting more expensive" narrative: priced per finished task, costs are flat.
- Newest closed models finish 98%+ of multi-step enterprise jobs with few hallucinations
- Top PINNACLE score moved 3.6x in two weeks; top-tier cost per finished task rose only 11%
- GPT-6 lists at 2.5x GPT-5.6 but costs the same per finished job; Gemini 3.8 Flash makes 11x fewer errors than the best Gemma for 1.5x the cost
Bottom line: price per token went up, price of finished work did not — agentic capability is improving faster than pricing. The benchmark uses deterministic code-verified scoring, with NVIDIA Blackwell Ultra and AMD as platform partners.
Related event: Signal65's PINNACLE Benchmark: AI Cost Per Completed Task Hasn't Risen(2 posts)→
More from Models
- ChatGPT Recommended an Incompatible SSD, User Wants Extra Tokens as Compensation — AYCA0001 · 2026-09-12
- Astra replication shows 1.75x reasoning steps without chain-of-thought, a 'concerning trend' — burny_tech · 2026-09-12
- Model identifies blurred fastener standards book from a compressed PDF screenshot — iplawguy · 2026-09-12
- Relace hits 1T tokens/day on OpenRouter, serving 37% of DeepSeek v4 Flash traffic — stuffyokodraws · 2026-09-12
- GPT-6 Astra takes #1 spot on VerBench — nobodyreadusernames · 2026-09-12
- Grok Bot rolls out on Grok web app, xAI pitches it as your everything app — nima_owji · 2026-09-12