A benchmark chart puts a flash model around 5th place, but critics say it is far pricier
soumitrashukla9 · x · 2026-07-22
The attached benchmark chart compares models on intelligence, speed, and cost per task. The quoted reply argues that the comparison is misleading because the models in question are 4–7× more expensive and much larger, even though the flash model still ranks competitively.
- On the Intelligence chart, the flash model is around the middle of the pack, tied for 5th on AA index.
- The critic says the comparison should account for model size and cost.
- Their main complaint is not capability, but that the model should be cheaper.
More from Models
- Unverified: GPT-6.1 Terra reportedly released, leaked chart shows top score per dollar on Agents' Last Exam — ZeroStateReflex · 2026-10-27
- GPT-6.1 Terra reportedly launches at $1/M input, half the price of Sonnet — bindureddy · 2026-10-27
- GPT-6.1 Terra cuts factual error rate from 22.3% to 4.3%, an ~81% drop — haider1 · 2026-10-27
- GPT-6.1 Terra lands: early users praise speed, value and subagent performance — BenBajarin · 2026-10-27
- Leaked GPT-6.1 Terra benchmarks: cheap but 'boring', still far behind Astra and Claude — Angaisb_ · 2026-10-27
- Artificial Analysis Ships Intelligence Index v4.3.2 With GPT-6.1 Terra Comparison — ArtificialAnlys · 2026-10-27