Pareto 26.9 routes across models, ties GPT-6 on 30 agent tasks at 1/3 the cost
omarsar0 · x · 2026-09-25
- Composio benchmarked 6 models on 30 challenging agent tasks: GPT-6 Astra, Opus 5.5, GPT-6 Sol, Pareto 26.9, DeepSeek V4 Pro, and GLM 5.3 Flash.
- Pareto 26.9 from TheUnbiasedCo sends requests to several frontier and open models and keeps the best answer; it tied GPT-6 Astra for first place at roughly 1/3 the cost per successful task, and finished faster than DeepSeek V4 Pro and GLM 5.3 Flash.
- GPT-6 Sol matched Opus 5.5's score while running faster and costing about a quarter as much per successful task.
- Takeaway: blended multi-model routing is emerging as a serious strategy for agent workloads.
More from Models
- Do typos discomfort LLMs? Tokenization quirk sparks debate — menhguin · 2026-11-11
- MiniMax H3 hits 100 days open-source: 1,472 derivative models, 148M+ downloads — linoy_tsaban · 2026-11-11
- Meituan's LongCat-2.5 trends on Hugging Face as MoE multimodal model — meituan-longcat · 2026-11-11
- Fable 5.2 hands-on: great at well-defined hard problems, best since GPT 6 Astra — rachittshah · 2026-11-11
- The next AI vendor lock-in won't be the model API, it'll be the harness — Arindam_1729 · 2026-11-11
- Leaked: OpenAI's GPT-6.2 (codename betelgeuse) reportedly weighs in at ~15T tokens, drops Thursday — iruletheworldmo · 2026-11-11