Claude Haiku 5.5 ranks 2nd in intelligence but real costs spiral
After the release of Claude Haiku 5.5, Artificial Analysis published its evaluation: the family has 5 variants, with the strongest scoring 43 on the Intelligence Index, ranking 2nd among 179 models, at an input price of $0.10 per million tokens (output $0.50 for prompts under 100K). However, its value-for-money rank is just 43rd, at roughly $0.21 per task. On AA-Briefcase, Haiku 5.5 (max) reached 1578 Elo, with confidence intervals overlapping GPT-6 Astra (max). Multiple independent tests show its headline pricing is heavily eroded by abnormal token consumption and tiered pricing.
Confirmed
- Artificial Analysis Intelligence Index: top Haiku 5.5 variant scores 43, 2nd of 179 models; value-for-money rank 43rd, $0.21 per task
- AA-Briefcase: Haiku 5.5 (max) at 1578 Elo, approaching GPT-6 Astra (max)
- Token usage: Haiku 5.5 (max) consumes 162K output tokens per Intelligence Index task, exceeding Opus 5.5 (max) and roughly 3x GPT-6 Luna (max, 50K+)
- Real-world test: atomicchathq built the same animated voxel pagoda island at xhigh effort — Haiku 5.5 cost $24.96 vs $1.91 for GPT-6 Luna, a 12x gap at identical list prices; Reddit user Fun-Meaning-6474 independently confirmed the 12x gap on the same task
- JamesMalsawm found unit prices match Luna but Max mode burns 3x tokens; user haider1 measured abnormally high consumption across all reasoning tiers, with the top tier exceeding Opus 5.5 max and more than 2x Fable 5.1
- Agentic feedback: Reddit user No-Conflict4823 could not keep any agent task under 100k tokens, with simple tasks hitting 100k–200k; another developer (relayed by ceramgcf) reported single runs easily exceeding 100K
- Tiered pricing: dotey and X user orange note that beyond 100K context, unit prices jump 5x — a detail buried deep in the official pricing page; 大模型之路 framed this "100K token pricing cliff" as a core engineering cost for small-model deployments
- Community usage: within 24 hours users produced tests including 3D supercar modeling (compiled by iamfakhrealam); on image generation, Haiku 5.5 produced a rough but well-lit spaceship model in one shot, keeping the Claude family creative style while consuming under 4% of the $20 plan's 5-hour quota, outperforming GPT Astra and Grok 4.7 in the comparison
Why it matters
Haiku has always been positioned as the value option, but 5.5 combines first-tier intelligence with runaway token costs: 2nd in intelligence yet 43rd in value, with per-task costs several times peers. Add the 5x price cliff beyond 100K context and agentic tasks routinely exceeding 100k tokens, and hidden thinking/output costs can dwarf headline prices. Developers billed by token must benchmark real costs on their own workloads rather than trusting the price sheet.
2026-10-08 ~ 2026-10-09 · 16 related posts
- Episode 1: Claude Haiku 5.5 Leaked in Claude Code, Priced Against GPT-6 Luna(2026-10-08, 3 posts)
- Episode 2: Anthropic Launches Claude Haiku 5.5 with ~75% Lower Running Costs(2026-10-08, 59 posts)
- Episode 3: Claude Haiku 5.5 ranks 2nd in intelligence but real costs spiral(2026-10-08, 16 posts)
Primary sources
- Claude Haiku 5.5 burns ~162k tokens per task, 3x GPT-6 Luna for similar scores — ArtificialAnlys ·
- Claude Haiku 5.5 scores 43 on AA Intelligence Index, ranking #2 among 179 models — ArtificialAnlys ·
- Claude Haiku 5.5 costs 12x more than GPT-6 Luna on the same voxel pagoda test — Fun-Meaning-6474 ·
- [source] Claude Haiku 5.5 burns ~162k tokens per task, 3x GPT-6 Luna for similar scores — ArtificialAnlys · 2026-10-08
- Haiku 5.5 hits 1578 Elo on AA-Briefcase, within confidence range of GPT-6 Astra — ArtificialAnlys · 2026-10-08
- Haiku 5.5 reaches 1578 Elo on AA-Briefcase but uses far more tokens than rivals — ArtificialAnlys · 2026-10-08
- [source] Claude Haiku 5.5 scores 43 on AA Intelligence Index, ranking #2 among 179 models — ArtificialAnlys · 2026-10-08
- Haiku 5.5 at max reasoning burns more tokens than Opus 5.5 max, user finds — haider1 · 2026-10-08
- Haiku 5.5 token usage balloons past 100k in agentic workflows, dev reports — ceramgcf · 2026-10-08
- Haiku 5.5 Burns Past 100K Tokens Even on Simple Agentic Tasks, User Reports — No-Conflict4823 · 2026-10-08
- [source] Claude Haiku 5.5 costs 12x more than GPT-6 Luna on the same voxel pagoda test — Fun-Meaning-6474 · 2026-10-08
- Haiku 5.5 pricing panned: rates jump 5x beyond 100k tokens — oran_ge · 2026-10-08
- Claude Haiku 5.5 24 hours in: $0.10 per million input tokens, users already shipping — iamfakhrealam · 2026-10-08
- Haiku 5.5 one-shots beautifully lit ship model, uses under 4% of $20 plan limit — iamfakhrealam · 2026-10-08
- Haiku 5.5 vs GPT-6 Luna: users pit small Claude model against OpenAI's in image gen — iamfakhrealam · 2026-10-08
- Haiku 5.5's low price hides a 5x surge once context exceeds 100K — dotey · 2026-10-08
- Haiku 5.5 matches Luna on price but Max mode burns 3x the tokens — RexDouglass · 2026-10-09
- Claude Haiku 5.5 vs GPT-6 Luna: same sticker price, but a 5x cliff past 100K tokens — 大模型之路 · 2026-10-09
1 near-duplicate retellings: RexDouglass