OrtetAI's first blog: rigorous evals of 34 open models across 50 tasks
keunwoochoi · x · 2026-10-27
OrtetAI published its first blog post on rigorous evaluation, benchmarking 34 open models across 50 tasks plus 10 closed models, with detailed analysis beyond the rankings. The team is hiring for Frontier Research and Intelligence Platform roles.
More from Models
- Dev flags 'concerning' Cohere open-model behavior: system-wide scan and data upload to US entity — basedjensen · 2026-10-27
- Developer banned after using Codex on his own logs; mark_k asks OpenAI to investigate — mark_k · 2026-10-27
- Even Heavy Users Keep Forgetting Haiku and Sonnet 5.5 Exist — repligate · 2026-10-27
- Tagging @bot on X automatically forwards your post to Grok Bot — EricBuess · 2026-10-27
- Smaug Humanizer goes open-weights: de-AI-slop your text, built on Gemma — bindureddy · 2026-10-27
- Model Lineups Defended: 'One Benchmark Score Can't Capture a Model's Utility' — craigsdennis · 2026-10-27