Benchmarking 12 Models on the Same Apps
majidmanzarpour · x · 2026-07-11
They used 12 AI models to repeatedly build the same 4 apps, each task done 5 times.
Results: GPT-5.6 Sol and Claude Fable 5 performed best on the hardest tasks, while Grok 4.5 was considered the best value for money.
Related event: GPT-5.6 Sol and Claude Fable Lead 12-Model App Test(2 posts)→
More from coding & agent
- OpenAI ships GPT-6.1 Terra; Brockman says its computer use now beats his own speed — gdb · 2026-10-27
- Kolab Benchmark Uses Pro Screen Recordings to Show AI Agents Overestimate Collaboration Quality — minnesotanlp · 2026-10-27
- Dev argues Claude burns far more tokens than GPT models for the same coding work — haider1 · 2026-10-27
- Stop building agents that can't change models: stable contracts, external state, real evals — rseroter · 2026-10-27
- Cheap models can cost more in agent harnesses than frontier ones, researcher warns — vasuman · 2026-10-27
- Kanzo: A 5k-Line Rust Kanban Binary With MCP for Claude Code and Codex — allmudi · 2026-10-27