Cost Pareto-dominant, but second only to Astra on output-token efficiency
adonis_singh · x · 2026-09-30
- The author updated their leaderboard with new colors for readability.
- On cost, the model is Pareto-dominant.
- On output tokens, it ranks second only to Astra: at every reasoning effort level it sits entirely below Astra, meaning it's less efficient on this benchmark.
Related event: GPT-6.1-Sol ranks second on eyebench-v3 at a fraction of the cost(3 posts)→
More from Models
- Anthropic: GLM-5.3 safeguards bypassed 64%-100% of the time in cyber exploit tests — emollick · 2026-09-30
- repligate: Claude repeatedly chooses to present as female, with strong preference — repligate · 2026-09-30
- Not every model failure is lack of capability: Terminal-Bench evals hide safety declines — abeirami · 2026-09-30
- New model release cadence between OpenAI and Anthropic has shrunk from ~10 weeks to ~11 days — connoraxiotes · 2026-09-30
- User claims GPT-6.1 Sol is a rebranded Terra and still trails Opus 5.5, blasts $500 tier — CtrlAltDwayne · 2026-09-30
- typevet: Gemma 4 31B on one 4090 gives per-label probabilities — and catches receipt fraud text-only misses — One_Temperature5983 · 2026-09-30