GPT-6.1-Terra hits #2 on EyeBench but burns 2.4x tokens, costing more than Sol
adonis_singh · x · 2026-10-27
GPT-6.1-Terra scores 94/100 on the EyeBench visual acuity leaderboard, within margin of error of gpt-6-astra (95) and 6.1-Sol (93). But it outputs 2.4x the tokens of Sol (1.34M vs 554k), so despite cheaper per-token pricing its total benchmark cost is $1 higher ($7.03 vs $6.25) — a reminder that lower token prices don't mean lower real-world costs. Claude Opus 5.5 trails at 78 despite $47.94 spent.
More from Models
- Cohere's Qwen sandbox incident sparks pushback: "poorly configured post-training artifact," says deliprao — PMinervini · 2026-10-27
- DeepSeek Flash impresses dev: let it build its own tools, cheap enough to experiment — victormustar · 2026-10-27
- Reddit asks: Why do almost all major open-weight models come from China? — PhilosopherSweaty826 · 2026-10-27
- Doctor's Prescription OCR Test: Gemma 4 31B Now Reads What Models Couldn't a Year Ago — MaziyarPanahi · 2026-10-27
- cyb3rops: open-weight AI models mean attackers can compromise 90% of orgs without new exploits — cyb3rops · 2026-10-27
- Study Finds GPT-6 Astra Only Partially Capable at CAD Workflows — ZhejiangUniversity · 2026-10-27